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Abstract 

This  grant  supported  a  workshop,  held  at  Caltech  in  August  2004,  that 
brought  together  experts  in  quantum  mechanics,  control  theory,  and  dynam¬ 
ical  systems  for  an  exchange  of  ideas  on  the  analysis,  control,  and  design  of 
quantum  systems.  One  of  the  major  goals  of  the  workshop  was  to  establish 
substantive  technical  interactions  between  physicists  working  on  quantum  ‘ap¬ 
plications’  and  control  and  dynamical  systems  researchers  who  have  insights 
and  tools  but  lack  a  concrete  sense  of  what  problems  are  of  primary  interest. 

The  workshop  highlighted  anticipated  applications  of  quantum  control  in  quan¬ 
tum  information  science,  control  of  molecular  reactions,  and  design  of  electronic 
and  photonic  nanostructures.  The  workshop  results  are  available  on  the  web 
and  documented  in  a  paper  that  has  been  submitted  to  to  the  International 
Journal  of  Robust  and  Nonlinear  Control. 

A  copy  of  the  report  generated  based  on  the  discussions  in  the  workshop  is  at¬ 
tached. 
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Talks  were  presented  in  the  Lees-Kubota  lecture  hall  at  Caltech  in  Pasadena,  California. 

The  first  two  days  focused  on  developing  an  overview  of  the  field,  from  theoretical 
perspectives  to  experimental 

challenges  and  opportunities.  During  the  third  and  fourth  days  the  emphasis  turned  to 
detailed  modeling  and 
mathematical  methods. 
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SUMMARY 

We  describe  in  this  article  some  key  themes  that  emerged  during  a  Caltech/AFOSR  Workshop  on 
“Principles  and  Applications  of  Control  in  Quantum  Systems”  (PRACQSYS),  which  was  held  21-24 
August  2004  at  the  California  Institute  of  Technology.  This  workshop  brought  together  engineers, 
physicists  and  applied  mathematicians  to  construct  an  overview  of  new  challenges  that  arise  when 
applying  constitutive  methods  of  control  theory  to  nanoscale  systems  whose  behavior  is  manifestly 
quantum.  Its  primary  conclusions  were  that  the  number  of  experimentally  accessible  quantum  control 
systems  is  steadily  growing  (with  a  variety  of  motivating  applications),  that  appropriate  formal 
perspectives  enable  straightforward  application  of  the  essential  ideas  of  classical  control  to  quantum 
systems,  and  that  quantum  control  motivates  extensive  study  of  model  classes  that  have  previously 
received  scant  consideration.  Copyright  ©  2004  John  Wiley  &  Sons,  Ltd. 

KEY  WORDS:  Quantum,  nonlinear,  stochastic 


1.  Introduction 

Modern  scientific  inquiry  and  the  demands  of  advancing  technology  are  driving  theoretical 
and  experimental  research  towards  control  of  quantum  systems.  Compelling  applications  for 
quantum  control  have  been  noted  and  have  motivated  seminal  studies  in  such  wide-ranging 
fields  as  chemistry,  metrology,  optical  networking  and  computer  science.  Experience  has  so 
far  shown  that  quantum  dynamics  and  stochastics  can  be  incorporated  within  the  framework 
of  estimation  and  control  theory  but  give  rise  to  unusual  models  that  have  not  yet  been 
studied  in  depth.  The  microscopic  nature  of  quantum  systems  also  demands  renewed  emphasis 
on  accounting  for  the  essentially  physical  (finite  impedance)  nature  of  measurement  and 
feedback  interconnections,  which  limits  the  applicability  of  state-feedback  formalism  and  makes 
quantum  filtering  an  essential  methodology  for  closed-loop  control.  Open-loop  control  remains 
effective  in  the  quantum  regime  but  the  actuation  terms  are  generically  bilinear.  Overall,  one 
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begins  to  see  that  novel  features  of  quantum  systems  could  spur  the  growth  of  a  new  branch 
of  control  theory  to  develop  hand-in-hand  with  the  cutting-edge  applications  that  drive  it. 

We  should  be  careful  to  note  that  theoretical  foundations  for  quantum  control  have  been  in 
place  for  some  time.  Among  the  participants  of  our  small  workshop,  V.  P.  Belavkin,  H.  Rabitz 
and  T.-J.  Tarn  each  reviewed  seminal  work  dating  back  to  the  1980’s  [1,  2,  3].  But  the  current 
resurgence  of  interest  may  be  attributed  to  recent  advances  in  experiments  on  quantum 
control  and  to  the  emergence  of  high-profile  applications  in  metrology,  physical  chemistry, 
quantum  information  science  and  spintronics.  It  thus  seems  appropriate  here  to  emphasize 
the  importance  of  grounding  further  theoretical  investigations  of  quantum  control  in  concrete 
experimental  settings  and  design  goals  of  practical  interest. 

Our  intent  in  writing  this  article  is  not  to  present  a  comprehensive  review  of  the  field, 
but  rather  to  attempt  to  provide  a  timely  piece — motivated  by  presentations  given  at  the 
PRACQSYS  Workshop) — that  can  indicate  some  points  of  entry  into  the  recent  literature  on 
quantum  control  and  its  applications.  We  begin  with  a  brief  introduction  and  overview  of  some 
compelling  applications  for  quantum  control,  continue  with  a  survey  of  relevant  experimental 
systems,  and  then  turn  to  a  more  formal  presentation  of  mathematical  models  and  some  open 
problems. 


2.  Quantum  control  scenarios  and  applications 

A  question  that  inevitably  arises  in  any  introduction  of  quantum  control  is,  “What  makes  a 
control  system  quantum ;?”  In  principle,  our  current  understanding  of  physics  holds  that  all 
systems  are  quantum  but  that  manifestly  non-classical  phenomena  are  observable  only  under 
special  laboratory  conditions.  Roughly  speaking,  quantum  ‘behavior’  emerges  in  scenarios 
where  a  relatively  small  physical  system  (with  few  active  dynamical  degrees  of  freedom)  can  be 
well  isolated  from  environmental  perturbations  and  dissipative  couplings.  In  some  experiments 
this  effectively  can  be  achieved  by  bringing  an  experimental  apparatus  to  very  low  temperatures 
(as  is  the  case  in  the  superconducting  circuit  experiments  cited  below),  while  in  others  one  can 
exploit  a  separation  of  energy  and/or  time  scales  to  observe  transient  quantum  behavior  at 
room  temperature  (as  in  the  experiments  performed  on  atomic  ensembles  and  in  liquid-state 
nuclear  magnetic  resonance).  From  a  more  formal  perspective,  one  could  say  that  quantum 
mechanics  is  believed  to  be  a  correct  microscopic  theory  of  (non-relativistic)  physics  but  that 
the  reduced  dynamics  of  subsystems  nearly  always  corresponds  closely  to  models  that  fall  within 
the  domain  of  classical  mechanics.  Hence  strongly  non-classical  behavior  can  only  be  observed 
in  a  subsystem  on  timescales  that  are  short  compared  to  those  that  characterize  its  couplings 
to  its  environment.  In  the  case  of  any  macroscopic  object,  such  as  an  ordinary  mechanical 
pendulum,  there  are  so  many  such  couplings  ( e.g .,  via  mechanical  coupling  to  its  support  and 
to  air  molecules)  that  these  timescales  are  inaccessibly  short.  From  an  even  more  abstract 
perspective,  one  could  say  that  Schrodinger’s  Equation  is  meant  to  apply  to  the  universe 
as  a  whole  (whose  ‘internal’  degrees  of  freedom  are  densely  interconnected)  while  physical 
experiments  deal  only  with  embedded  subsystems.  Unless  great  care  is  taken  to  suppress 
the  environmental  couplings  of  an  experimental  system,  the  overwhelming  tendency  is  for  its 
behavior  to  appear  classical,  or  at  least  imperfectly  quantum. 

The  accurate  quantitative  modeling  of  ‘imperfectly  quantum’  behavior  in  open  systems 
(i.e.,  those  with  non-negligible  residual  environmental  couplings)  is  a  subject  of  intense  study 
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in  many  branches  of  physics.  Generally  speaking,  one  finds  fundamental  theory  in  the  fields  of 
quantum  statistical  mechanics  and  mathematical  physics,  with  more  system-specific  results  in 
fields  such  as  atomic  physics,  quantum  optics  and  condensed  matter  physics.  One  of  the  main 
goals  for  theoretical  research  in  quantum  control  will  be  further  to  integrate  what  is  known 
from  the  physics  of  open  quantum  systems  with  core  engineering  methodologies. 

A  second  question  that  may  naturally  arise  at  this  point  is,  “Why  should  we  study 
quantum  control?”  One  answer  is  that  the  above-mentioned  integration  of  the  theory  of 
open  quantum  systems  with  estimation  and  control  appears  to  provide  an  important  new 
conceptual  framework  for  the  interpretation  of  quantum  mechanics  itself.  By  scrutinizing 
quantum  mechanics  as  a  theory  for  the  design  of  devices  and  systems,  as  opposed  to  a  theory 
for  scientific  explanation  only,  we  gain  new  insight  into  obscure  features  of  quantum  theory 
such  as  complex  probability  amplitudes  and  ‘collapse  of  the  wave  function.’  In  particular 
we  are  able  to  make  more  focused  comparisons  between  classical  and  quantum  probability 
theories.  But  a  second  compelling  answer  to  the  question  at  hand  is  that  various  branches  of 
research  on  nanotechnology  are  advancing  to  the  point  of  investigating  ‘mesoscopic’  devices 
whose  behavior  remains  quantum  on  timescales  of  functional  relevance.  It  thus  seems  clear 
that  in  order  fully  to  exploit  the  powerful  methodologies  of  control  theory  in  the  design  and 
implementation  of  advanced  nanoscale  technologies,  control  theory  needs  to  be  reconciled  with 
quantum  mechanics. 

As  we  hope  the  following  discussion  will  illustrate,  this  reconciliation  does  not  appear  to 
require  any  radical  reformulation  of  control  theory.  It  does  however  seem  that  nanoscale 
systems  (broadly  defined)  and  quantum  control  present  new  classes  of  models  that  fit  within 
the  scope  of  traditional  analysis  and  synthesis  methods  but  have  yet  to  be  studied  in  depth.  To 
date  there  have  been  a  number  of  publications  that  demonstrate  the  use  of  standard  control- 
theoretic  techniques  to  analyze  models  of  quantum-physical  origin;  we  will  not  attempt  to 
review  them  here.  We  prefer  to  emphasize  the  recent  development  of  concrete  applications— 
tied  to  experimental  research — that  generate  urgent  questions  most  naturally  addressed  by 
quantum  extensions  of  estimation  and  control  theory.  These  applications  and  questions  are 
in  turn  motivating  the  thorough  and  principled  development  of  certain  practical  aspects  of 
quantum  control. 

A  first  major  application  area,  to  be  described  in  greater  detail  below,  is  protein  structure 
determination  via  nuclear  magnetic  resonance  (NMR).  Ideas  from  control  theory  have  clear 
relevance  to  this  field  because  protein  structure  determination  can  naturally  be  viewed  as  a 
problem  in  system  identification.  In  the  typical  setting  one  has  foreknowledge  of  the  types 
of  atomic  nuclei  that  constitute  a  given  protein,  and  has  experimental  tools  that  can  induce 
rotations  of  these  individual  nuclei  and  collect  signals  that  gauge  their  precise  response  to 
applied  controls.  The  unknown  parameters  of  the  system  are  the  relative  spatial  positions  of  the 
various  nuclei,  which  can  be  inferred  from  experiment  by  estimating  the  relative  strengths  of  the 
dynamical  couplings  among  them.  Questions  of  optimal  procedure  arise  because  measurement 
signal-to-noise  ratios  are  typically  quite  low,  because  dissipative  mechanisms  suppress  the 
observability  of  dynamical  couplings  among  the  nuclei,  and  because  the  total  number  of 
measurements  that  must  be  made  to  establish  the  structure  of  a  protein  is  tremendously  large 
(thus  putting  a  premium  on  the  speed  of  the  identification  procedure).  It  is  intriguing  to  note 
that,  even  though  NMR  researchers  have  been  working  for  many  decades  to  optimize  relevant 
techniques,  the  recent  introduction  of  control  theoretic  methods  has  enabled  some  substantial 
improvements  in  performance  (with  high  practical  impact).  Many  further  opportunities  can 
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be  identified  for  the  application  of  control  theory  to  NMR. 

Over  the  past  decade,  a  number  of  groups  have  proposed  and  demonstrated  close  connections 
between  magnetic  resonance  (of  nuclear  and/or  electronic  spins)  and  quantum  information 
processing.  The  quantum  states  of  nuclei  in  certain  types  of  molecules  and  solid-state  systems 
can  be  well  shielded  from  environmental  perturbations,  making  them  an  attractive  physical 
locus  for  the  storage  and  processing  of  quantum  information.  Manipulation  of  individual 
nuclear  states  and  conditional  transformations  of  the  state  of  one  nucleus  based  on  that  of 
another  (corresponding  to  the  implementation  of  a  quantum  logic  gate)  can  be  accomplished 
via  tailored  radio-frequency  electromagnetic  fields.  In  this  context  questions  of  optimal  control 
arise  for  much  the  same  reasons  as  in  protein  structure  determination,  with  the  additional 
consideration  that  large-scale  quantum  computation  may  require  extremely  high  fidelity  (with 
inaccuracy  <  10~4)  in  these  elementary  quantum  state  transformations  [4,  5].  This  need  for 
high  fidelity  can  be  compounded  by  the  fact  that  in  real  experiments  it  is  typically  necessary 
(especially  in  NMR)  to  work  with  a  sample  containing  very  many  identical  molecules,  in  order 
to  make  the  ‘readout’  signals  sufficiently  strong  that  they  can  be  detected  above  instrumental 
noise.  The  unavoidable  presence  of  inhomogeneities  across  such  a  large  sample  of  molecules 
then  demands  a  certain  degree  of  robustness  in  the  control  policies  employed,  generating  further 
interesting  challenges  for  the  theory. 

Similar  quantum  control  problems  arise  in  a  wide  range  of  physical  implementations  of 
quantum  information  processing.  In  systems  from  atomic  physics,  the  nature  of  the  problems 
is  very  similar  to  what  has  been  described  above  for  the  setting  of  magnetic  resonance.  In  solid- 
state  systems,  one  generally  finds  an  intriguing  combination  of  issues  of  both  identification  and 
control.  Whereas  accurate  ab  initio  models  can  often  be  constructed  for  NMR  and  atomic 
systems,  the  modeling  of  solid  state  systems  typically  requires  a  more  phenomenological 
approach.  In  particular,  it  is  seldom  possible  to  derive  accurate  models  for  the  residual 
environmental  couplings  of  something  like  a  superconducting  quantum  circuit.  The  precise 
nature  and  strength  of  these  couplings  should  be  known  in  order  to  design  control  schemes 
that  maximize  the  fidelity  of  elementary  quantum  operations,  which  as  discussed  above  should 
be  very  close  to  perfect  if  one  is  ultimately  interested  in  large-scale  quantum  computation. 
Some  recent  theoretical  research  [6,  7,  8]  has  also  shown  that  tools  from  control  and  dynamical 
systems  theory  can  play  a  substantial  role  in  the  formulation  and  analysis  of  fault-tolerant 
architectures  for  quantum  computation  and  communication. 

Quantum  computation  represents  a  very  high-profile  long  term  goal  in  nanoscale  science 
and  technology;  the  related  field  of  quantum  metrology  (or  quantum  precision  measurement) 
provides  a  setting  with  similar  technical  challenges  and  with  near-term  payoffs  for  the 
exploitation  of  quantum  control.  In  applications  of  high  strategic  and  industrial  interest, 
such  as  prompt  and  accurate  estimation  of  magnetic  fields,  electrical  currents,  time  delays, 
gravitational  gradients,  accelerations  and  rotations,  it  is  just  now  becoming  possible  to 
construct  laboratory  prototype  systems  whose  leading-edge  performance  is  enabled  by 
techniques  that  exploit  quantum  coherence  and  is  limited  by  noises  or  uncertainties  of 
quantum-mechanical  origin.  In  these  contexts  it  is  natural  to  look  to  quantum  control  to 
provide  techniques  for  achieving  robust  performance,  based  on  approaches  such  as  optimal 
design,  adaptation  and  real-time  feedback.  Preliminary  studies  grounded  in  several  different 
experimental  settings  [9,  10]  have  shown,  e.g.,  that  real-time  feedback  can  be  used  to  preserve 
quantum-limited  sensitivity  gains  in  the  presence  of  multiplicative  uncertainties  that  would 
otherwise  nullify  them.  Concrete  targets  for  the  application  of  such  methodology  range  from 
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atom  interferometer-based  inertial  sensing  systems  to  grand  scientific  projects  such  as  the  Laser 
Interferometer  Gravitational  Wave  Observatory  (LIGO).  In  both  of  these  examples  [11, 12,  13], 
promising  strategies  exploiting  quantum  phenomena  have  been  formulated  to  surpass  near- 
term  performance  limits,  but  quantum  control  techniques  will  likely  be  required  in  order  to 
implement  them  robustly. 

The  final  application  area  we  wish  to  highlight  is  control  and  identification  of  chemical 
reactions.  As  has  been  discussed  in  some  excellent  recent  review  articles  [14,  15],  tailored  laser 
pulses  can  be  used  to  induce  and  to  steer  molecular  processes  ranging  from  fragmentation  [16] 
to  electron  transfer  [17]  and  high-harmonic  generation  [18].  It  has  been  noted  that  the  typically 
complex  nature  of  the  interaction  between  applied  fields  and  intrinsic  dynamics  in  an  optimal 
control  solution  could  make  it  possible  to  design  highly  selective  and  sensitive  approaches  to 
detecting  dangerous  chemicals  in  an  environmental  monitoring  scenario  [19,  20].  An  interesting 
feature  of  recent  work  on  control  of  chemical  reactions  is  that  highly  successful  control 
solutions  have  been  ‘discovered’  using  learning  loops  that  combine  computer  optimization 
algorithms  with  fast  and  automated  laboratory  apparatus  for  experimentally  (as  opposed 
to  computationally)  evaluating  the  performance  of  trial  solutions.  Such  an  approach  is 
particularly  powerful  in  the  chemical  reaction  setting  as  it  is  often  infeasible  to  obtain  accurate 
models  for  the  relevant  molecular  dynamics.  Early  experimental  successes  have  provided 
strong  motivation  for  theoretical  research  on  improved  learning  algorithms  and  on  methods 
for  ‘inverting’  the  empirically-optimized  control  solutions  to  infer  pertinent  properties  of  the 
molecular  dynamics. 

In  the  applications  described  in  this  paper,  some  common  themes  and  problems  emerge 
from  the  standpoint  of  mathematical  control  theory.  Many  experiments  and  applications 
involving  control  of  quantum  dynamics  like  magnetic  resonance  involve  manipulation  of 
quantum  ensembles.  The  members  of  the  ensemble  though  having  identical  dynamics,  could 
show  a  big  dispersion  in  their  physical  parameters  that  characterize  the  dynamics.  The  control 
challenge  is  to  find  excitations  that  are  robust  to  these  dispersions  and  inhomogeneities.  These 
problems  lead  naturally  to  study  of  a  class  of  infinite  dimensional  systems  that  are  highly 
under- actuated,  as  one  is  trying  to  steer  a  continuum  of  systems  using  the  same  control.  Such 
control  models  raise  interesting  issues  of  controllability  that  are  discussed  in  Sec.  4.3.  Besides 
questions  related  to  controllability  of  finite  and  infinite  quantum  systems,  there  are  a  class 
of  optimal  control  problems  that  arise  naturally  in  coherent  control  of  quantum  phenomenon. 
Since  most  quantum  systems  in  practice  are  open,  excitations  that  steer  quantum  systems 
between  states  of  interest  in  minimum  time  are  desirable,  as  they  reduce  dissipative  effects 
of  environment.  From  perspective  of  mathematical  control  theory,  many  of  these  problems 
reduce  to  time  optimal  control  of  bilinear  systems  evolving  on  finite  or  infinite  dimensional  Lie 
groups.  Although,  bilinear  control  problems  have  been  studied  in  great  detail  in  classical  control 
literature,  rich  mathematical  structures  dictated  by  new  physical  problems  arise.  In  many 
cases,  the  added  structure  leads  to  complete  characterization  of  time  optimal  trajectories  and 
reachable  sets  for  many  of  these  systems  [21,  22].  These  results  of  fundamental  and  practical 
interest  in  the  areas  of  spectroscopy  and  quantum  information  are  described  in  some  detail, 
in  Sec.  4.1.  Another  class  of  optimal  control  problemthat  are  ubiquitous  in  applications  of 
quantum  control  is  steering  of  quantum  mechanical  systems  in  presence  of  relaxation.  The 
control  challenge  is  to  characterize  the  reachable  set  of  dissipative  bilinear  control  systems  and 
corresponding  optimal  controls.  Recent  work  has  shown  that  by  systematic  use  of  methods  of 
optimal  control,  significant  improvement  can  be  made  in  sensitivity  of  multidimensional  NMR 
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experiments  [23,  24,  25].  The  study  of  these  open  quantum  systems  leads  naturally  to  a  new 
class  of  constrained  bilinear  systems.  These  problems  are  discussed  in  Sec.  4.2.  We  believe,  the 
new  mathematical  structures  that  arise  in  problems  of  manipulation  of  quantum  dynamics  are 
excellent  motivation  for  further  developments  in  control  theory. 

The  problems  in  closed  loop  control  described  are  also  a  rich  source  of  new  problems  in 
estimation,  filtering  and  feedback  control.  Building  on  seminal  work  in  quantum  probability 
and  quantum  filtering  theory,  it  has  been  possible  to  derive  exact  results  for  ‘quantum  LQG’ 
problems  that  correspond  very  closely  to  analogous  results  in  classical  Linear  Quadratic 
Gaussian  control.  It  has  also  been  established  that  general  problems  in  quantum  feedback 
control  can  be  approached  via  a  separation  principle,  such  that  all  of  the  uniquely  quantum- 
mechanical  considerations  are  subsumed  in  the  derivation  of  appropriate  filtering  equations 
[26].  Control  synthesis  can  then  be  viewed  as  a  problem  of  state  feedback  on  the  estimator. 
The  availability  of  quantum  filtering  equations  also  enables  rigorous  approaches  to  (open-  and 
closed-loop)  quantum  parameter  estimation  and  quantum  system  identification.  In  addition 
to  the  intrinsic  interest  of  these  subjects,  we  should  note  that  they  represent  very  important 
problems  within  fields  such  as  quantum  information  science  and  quantum  metrology. 


3.  Experimental  systems 

In  this  section  we  provide  brief  overviews  of  three  broad  classes  of  experimental  systems  with 
close  ties  to  quantum  control.  As  mentioned  above,  coherent  control  of  molecular  dynamics  and 
:  chemical  reactions  has  recently  been  reviewed  [14, 15]  by  experts  in  the  field,  so  we  will  refer  the 
interested  reader  rather  than  synopsizing  their  materials  here.  While  tutorial  introductions  are 
beyond  the  scope  of  this  article,  our  aim  is  to  provide  theoretical  and  experimental  references 
in  a  manner  that  highlights  points  of  interest  to  the  controls  community. 


3.1.  Magnetic  resonance 

Few  analytical  techniques  in  science  match  in  the  breadth  and  depth  the  impact  achieved  by 
nuclear  magnetic  resonance  (NMR).  Starting  as  a  tool  for  characterization  of  organic  molecules, 
the  use  of  NMR  has  spread  to  areas  as  diverse  pharmaceutics,  metabolic  studies,  structural 
biology,  solid  state  chemistry,  condensed  matter  physics,  rheology,  medical  diagnostics  (medical 
resonance  imaging)  and  more  recently  neurobiology  [27,  28,  29].  The  principles  of  NMR  have 
served  as  paradigm  for  other  physical  methods  that  rely  on  interaction  between  radiation 
and  matter.  It  is  therefore  not  surprising  that  experiments  in  NMR  also  serve  as  good  model 
problems  in  control  of  quantum  systems.  In  this  section,  we  present  a  quick  review  of  the  basics 
of  magnetic  resonance  for  understanding  control  problems  arising  in  various  multidimensional 
experiments  in  high  resolution  NMR  spectroscopy. 

Modern  NMR  experiments,  use  a  large  static  magnetic  field  Bo  (say  pointing  in  the 
z  direction)  of  the  order  of  5-20  Tesla  to  align  magnetic  moments  of  atomic  nuclei  in  a 
sample  along  its  direction.  The  resulting  net  magnetization  M  in  the  direction  of  Bo  is  then 
manipulated  by  an  oscillating  radio  frequency  field  (Bx(t),  By(t))  in  the  x  —  y  plane,  which  is 
smaller  than  B0  by  4  to  5  orders  in  magnitude.  This  field  exerts  a  torque  on  M,  which  then 
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evolves  as  a  bilinear  control  system 
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An  oscillating  (Bx(t),By(t))  at  the  Larmor  frequency  u>o  =  'yBo,  (7  is  the  gyromagnetic  ratio 
of  nuclei)  i.e.  (Bx(t),By(t))  =  (A cos(ojf),  A sin(ofr)) ,  transfers  the  magnetic  moment  vector 
M(0)  =  (0,0,1),  to  the  x  —  y  plane.  At  this  point,  the  oscillating  field  is  switched  off  and 
the  magnetic  moment  precesses  around  the  static  magnetic  field  Bq  with  a  frequency  u>q.  This 
precessing  magnetic  moment  induces  a  current  in  a  nearby  coil  also  termed  as  free  induction 
decay  (FID).  This  FID,  when  fourier  transformed,  shows  a  peak  at  w 0,  a  characteristic  of  the 
nuclei.  At  a  field  of  14  Tesla,  the  Larmor  frequency  of  proton  (!H  ),  nitrogen  (15N)  and  carbon 
(13C)  is  600  MHz,  60MHz  and  150  MHz  respectively.  NMR  is  therefore  an  important  analytical 
tool  in  chemistry  as  the  peaks  in  the  spectra  reveal  the  chemical  composition  of  molecules. 
The  magnetic  moments  making  the  magnetization  vector  M  experience  local  fluctuations  in 
the  ambient  field  Bq  causing  them  to  loose  coherence  (decoherence).  This  gives  the  FID,  an 
decaying  envelop  and  the  peaks  in  the  spectrum  their  line  widths  (see  Fig.  3.1). 


Figure  1.  The  figure  shows  the  basic  features  of  an  NMR  experiment.  The  top  left  of  part  of  the  figure 
depicts  use  of  a  field  Bo  to  polarize  the  sample.  The  bottom  figure  shows  use  of  pulsed  magnetic 
fields  to  steer  the  net  magnetization  and  generate  FID.  The  top  left  panel  shows  the  profile  of  a  free 

induction  decay. 

The  experiments  in  structure  determination  of  biomolecules  using  NMR  [30,  31]  begins  with 
collecting  a  proton  spectra.  Protons  in  the  molecule  have  different  electronic  environments. 
These  electronic  currents  generate  small  magnetic  fields  which  alter  the  static  field  Bo  locally, 
hence  shifting  the  Larmor  frequency  of  these  protons.  The  resulting  proton  spectrum  has  many 
peaks  as  depicted  Fig.  3.1  A.  These  shifts  in  the  Larmor  frequency  are  characteristic  of  the 
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chemical  environment  of  the  spins.  Based  on  these  chemical  shifts,  it  possible  to  assign  the 
various  peaks  in  the  spectrum  of  a  molecule  to  various  protons,  a  process  called  frequency 
labeling  [30].  Following  this,  a  series  of  experiments  are  used  to  study  interaction  between 
various  frequency  labeled  protons,  which  gives  information  on  distance  between  protons  of 
various  amino  acids.  This  information  is  used  to  solve  for  a  folded  configuration  that  satisfies 
these  distance  constraints.  In  practice,  the  proton  spectrum  of  a  large  protein  molecule  is 
poorly  resolved  as  shown  in  Fig.  3.1  B.  This  is  due  to  crowding  of  the  spectrum  by  larger 
number  of  proton  resonances  and  their  increased  line  widths  caused  by  increased  decoherence 
rates  of  larger  proteins. 


Hi  H, 


A 


B 


Figure  2.  Panel  A  shows  the  proton  spectrum  of  a  small  peptide.  The  proton  resonances  are  clearly 
resolved.  Panel  B  shows  the  proton  spectrum  of  protein  Lysozome  at  a  magnetic  field  corresponding 
to  proton  frequency  of  750  MHz.  The  spectra  has  overlapping  resonance  lines. 

To  circumvent  this  problem,  methods  of  multidimensional  NMR  were  invented  [27],  The 
multidimensional  NMR  experiments  generate  a  two  dimensional  spectrum,  where  each  peak 
in  the  spectrum  is  labeled  by  Larmor  frequencies  of  a  coupled  spin  pair.  For  example,  the  first 
label  could  be  the  Larmor  frequency  of  a  proton  and  the  second  label  the  Larmor  frequency 
of  another  spin  coupled  to  proton,  say  15N.  As  a  result,  the  two  protons,  with  overlapping 
Larmor  frequencies  can  now  be  distinguished  by  their  nitrogen  frequencies.  This  way,  the  one 
dimensional  spectrum  of  protons  can  be  resolved  and  peaks  assigned  a  unique  frequency  label. 
The  basic  set  up  of  two  dimensional  NMR  experiment  is  depicted  in  Figure  3.1.  Initially  spins 
S  are  excited  by  an  oscillating  magnetic  field  with  frequency  corresponding  to  approximately 
their  Larmor  frequencies.  The  net  magnetization  of  the  spins  S  is  driven  to  transverse  plane 
where  it  precesses  for  some  time  f,  .  Then  by  application  of  external  rf  field  and  the  coupling 
between  the  spins  the  magnetization  is  transferred  from  spin  S  to  spin  /.  The  spins  I  are 
then  excited  and  the  precession  of  its  magnetization  is  recorded.  The  experiment  is  performed 
again  by  incrementing  the  value  of  t,,  resulting  in  a  two  dimensional  signal  *(ti,  *2)  indexed 
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by  the  time  t\  of  the  precession  of  the  spin  S  and  <2,  the  time  of  the  precession  of  spin 
I.  This  signal  takes  the  form  s(fi,t2)  =  r)COs(uJsti)  cos(a>/f2)  exp(-Rsti)  exp(— Rfa),  where 
Rj  and  Rs  are  relaxation  rates  for  spin  I  and  S  respectively  and  rj  is  the  efficiency  of  the 
magnetization  transfer  step.  A  two  dimensional  fourier  transform  of  this  signal  gives  peak  at 
frequency  ( )•  The  relaxation  rates  Rj  and  Rs  determine  the  linewidths  and  rj,  governs 
the  sensitivity  of  the  experiment. 


Figure  3.  The  left  panel  shows  a  coupled  two  spin  system  where  interactions  are  used  to  transfer 
magnetization  between  coupled  spins.  The  right  panel  shows  the  basic  features  of  a  2-dimensional 
NMR  experiment  where  magnetization  on  spin  evolves  for  time  1 1  followed  by  a  transfer  to  spin  I  and 

then  another  evolution  period  <2- 


The  basic  idea  of  a  2D  NMR  experiment  can  be  extended  to  3  or  4  dimensional 
experiments  which  generates  frequency  information  of  spins  in  a  coupled  spin  network.  In 
NMR  spectroscopy  of  proteins,  many  such  elaborate  experiments  have  been  developed  to 
improve  resolution  of  the  data  [31].  There  are  numerous,  beautiful  control  challenges,  related 
to  finding  the  optimal  rf-excitations  that  optimize  the  efficiency  of  transfer  of  magnetization 
in  a  network  of  coupled  spins.  From  perspective  of  control  theory,  these  are  control  problems 
related  to  steering  bilinear  control  systems  with  drift.  Finding  the  shortest  time  optimal  pulse 
sequences,  that  transfer  magnetization  between  coupled  spins  or  minimize  relaxation  losses 
and  thereby  maximize  r]  has  been  a  long  standing  research  area  in  NMR  spectroscopy.  Only 
recently  have  these  problems  been  addressed  from  a  control  theory  perspective.  These  problems 
involve  computing  reachable  sets  of  bilinear  control  systems  with  drift.  Physics  imposes  new 
mathematical  structures  in  these  problems.  This  has  made  it  possible  to  characterize  optimal 
trajectories  of  these  bilinear  control  systems  [21,  22,  23,  24,  25].  There  are  numerous  open 
problems  that  can  benefit  from  systematic  application  of  tools  from  control  theory.  These 
problems  of  optimal  control  of  coupled  spin  topologies  have  a  direct  bearing  on  the  area  of 
quantum  information.  Finding  optimal  excitations  to  generate  a  desired  evolution  in  a  network 
of  coupled  quantum  systems  is  a  canonical  problem  in  area  of  quantum  information.  These 
problems  are  discussed  in  some  detail  in  Sec.  4. 1-4. 3. 
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3.2.  Atomic  physics 

Basic  studies  of  atomic  internal  degrees  of  freedom  (which  determine  their  characteristic 
absorption  and  emission  spectra)  were  crucial  for  the  early  development  of  quantum  mechanics, 
and  in  recent  years  atomic  systems  have  again  become  the  focus  of  seminal  research  in 
quantum  control  and  related  fields.  Because  of  their  relative  simplicity  and  the  ease  with 
which  they  can  be  well  isolated  from  bulk  matter,  gas-phase  atoms  provide  a  canonical  setting 
in  which  to  validate  elementary  methodology.  Subtle  techniques  have  already  been  developed 
for  the  manipulation  of  electron  orbital  motion  and  hyperfine  spin  dynamics,  with  potential 
applications  in  quantum  information  processing  and  metrology.  The  invention  and  refinement 
of  laser  cooling  techniques  have  made  it  possible  to  observe  and  to  induce  quantum  phenomena 
in  the  center-of-mass  motion  of  atoms  as  well;  various  forms  of  matter- wave  interferometry  are 
now  widely  studied  and  there  has  recently  been  an  explosion  of  activity  in  the  study  of  quantum 
phase  transitions  of  cold  atoms  in  optical  lattices. 

Quantum  control  techniques  that  have  previously  been  developed  by  the  atomic  physics 
community  are  mainly  of  intuitive  origin.  In  many  cases  they  were  adapted  from  earlier  work  in 
magnetic  resonance  [28,  29].  But  researchers  working  on  atomic  systems  have  begun  to  explore 
the  utility  of  robust  pulse  sequences  from  NMR  [33]  and  of  optimal  control  theory  [32]  as  it 
has  been  formulated  by  physical  chemists  [2] ,  and  have  likewise  succeeded  in  generalizing  some 
principles  from  elementary  frequency  domain  feedback  control  [34,  35]  (a  working  knowledge 
of  which  is  required  for  the  design  and  maintenance  of  most  atomic  physics  experiments). 
As  it  is  often  possible  to  model  atomic  systems  essentially  from  first  principles,  sophisticated 
synthesis  techniques  from  control  theory  may  prove  to  have  great  practical  utility  and  to 
enable  vastly  improved  performance.  Preliminary  investigations  suggest  that  model  complexity 
can  be  a  serious  obstacle,  however,  as  can  limitations  on  current  technical  capabilities  for 
generating  complex  laser  control  fields.  Atomic  dynamical  timescales  can  also  be  quite  short 
(lying  generally  in  the  range  from  ~  10~9  to  ~  10-3  seconds),  which  presents  a  challenge 
for  the  implementation  of  closed-loop  methods.  Rigorous  model  reduction,  robustness  and 
‘non-fragility’  will  thus  be  highly  desirable  in  the  development  of  quantum  control  for  atomic 
systems. 

It  is  important  to  note  that  there  is  a  solid  theoretical  foundation  for  the  physical  modeling  of 
input  and  output  channels  for  atomic  control  systems.  In  particular,  continuous  measurements 
based  on  the  scattering  of  laser  light  by  atoms  can  be  accurately  modeled,  thus  enabling  a 
rigorous  treatment  of  the  quantum  mechanical  measurement  ‘backaction’  in  quantum  feedback 
control  (see  Sec.  4.4). 

Several  distinct  classes  of  atomic  experimental  systems  can  be  identified  with  relevance  to 
quantum  control.  After  decades  of  intense  laboratory  development,  trapped  ions  now  provide 
a  very  clean  realization  of  the  elementary  quantum  model  of  one  or  more  spins  coupled 
to  simple  harmonic  oscillators.  Relatively  long  coherence  times  can  be  obtained  in  trapped 
ion  experiments  together  with  very  low  effective  temperatures;  they  have  thus  become  quite 
important  for  applications  in  frequency  metrology  [36]  and  quantum  information  processing 
[37],  Various  techniques  have  been  established  for  manipulating  the  quantum  state  of  trapped 
ions  via  lasers  and  electric  fields,  and  some  of  these  have  been  analyzed  from  the  perspective  of 
geometric  control  theory  [38,  39].  As  far  as  open- loop  control  is  concerned,  trapped  ions  have 
provided  some  of  the  most  sophisticated  examples  of  quantum  control  to  date.  One  potential 
drawback  of  these  systems  (for  fundamental  studies  in  quantum  control)  is  that  real-time 
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monitoring  of  dynamical  variables  in  a  small  sample  of  trapped  ions  is  extremely  difficult  if  not 
impracticable  (see,  however  [40,  41]  for  significant  recent  progress).  For  practical  applications 
this  could  be  less  of  an  impediment  than  a  control  engineer  might  imagine,  however,  as 
stochastic  perturbations  can  be  kept  relatively  small  in  these  experiments,  high  purity  (low 
entropy)  initial  states  can  be  prepared,  and  many  useful  quantum  states  are  reachable  with 
current  actuation  capabilities. 

Many  of  the  attractive  features  of  trapped  ions,  such  as  relatively  long  coherence  times  and 
the  reachability  of  highly  non-classical  states,  can  also  be  found  in  single-atom  cavity  quantum 
electrodynamics  (cavity  QED)  [42],  In  modern  cavity  QED,  the  specially-arranged  environment 
of  an  electromagnetic  resonator  with  high  quality  factor  and  small  mode  volume  is  utilized  to 
achieve  strong  coupling  between  individual  atoms  and  photons.  Experiments  conducted  in  the 
microwave  regime  [43,  44],  with  Rydberg  atoms  and  superconducting  resonators  housed  in  a 
cryostat,  have  achieved  quantum  control  results  on  par  with  what  has  been  accomplished  using 
trapped  ions.  Experiments  in  the  optical  regime  [45],  with  ground-state  atoms  and  dielectric 
mirror  resonators,  have  recently  begun  to  produce  ground-breaking  results  in  active  control  of 
quantum  dynamics  as  well  [46]  (with  potential  applications  in  quantum  communication  and 
cryptography).  For  the  current  discussion,  optical  cavity  QED  has  the  significant  additional 
feature  of  being  the  one  of  the  few  experimental  settings  in  which  it  is  currently  possible  to 
perform  continuous  measurement  of  quantum  dynamical  variables,  as  would  be  required  for 
real-time  feedback  control.  Several  theoretical  papers  can  already  be  found  that  investigate 
applications  of  filtering  and  feedback  in  cavity  QED,  e.g .,  for  active  cooling  of  the  motion 
of  a  single  atom  [47]  or  for  control  of  the  atomic  resonance  fluorescence  spectrum  [48].  Early 
interest  in  aspects  of  quantum  control  for  cavity  QED  was  stimulated  by  potential  applications 
in  quantum  information  science,  and  also  by  a  strong  general  interest  within  the  field  in  non¬ 
equilibrium  statistical  mechanics  and  the  quantum-classical  interface  [49]. 

Experiments  on  large  ensembles  of  atoms  have  also  recently  entered  the  domain  of  quantum 
control.  Here  one  sub-class  of  experiments  utilizes  simple  vapor  cell  samples,  in  which 
special  technical  preparations  can  be  used  to  enable  long  coherence  times  for  collective 
internal  quantum  degrees  of  freedom  of  gas-phase  atoms  whose  center-of-mass  motions  are  at 
equilibrium  at  room  temperature.  Both  open-loop  [50]  and  closed-loop  [51]  experiments  have 
been  conducted  with  significant  interest  to  quantum  control,  although  the  direct  motivation 
of  these  works  was  more  along  the  lines  of  quantum  information  science.  A  second  sub-class  of 
experiments  on  atomic  ensembles  works  with  laser-cooled  clouds  of  gas-phase  atoms.  Again, 
both  open-  [52,  53]  and  closed-loop  [54]  experiments  have  been  performed,  with  motivations 
stemming  from  both  metrology  and  quantum  information  science.  The  open-loop  work  on 
interfering  pathways  in  laser  excitation  of  electronic  orbital  motion  provides  a  compelling 
demonstration  of  a  key  principle  from  the  physical  chemists’  perspective  on  quantum  control, 
and  may  have  the  potential  to  find  practical  application  in  stability  transfer  of  optical  frequency 
standards  [55].  The  closed-loop  work  is  related  both  to  feedback  stabilized  preparation  of 
quantum  states  (for  fundamental  studies  or  for  quantum  information  applications)  and  to 
proposed  schemes  [10]  for  robust  atomic  magnetometry  (magnetic  field  measurement).  The 
latter  work  connects  current  experiments  to  more  formal  theoretical  work  on  linear  quadratic 
Gaussian  (LQG)  quantum  control,  quantum  filtering  and  quantum  parameter  estimation  (see 
Sec.  4.4  and  Sec.  4.5  below). 

Although  the  essential  ideas  involved  in  quantum  control  with  atomic  ensembles  are  similar 
to  those  of  NMR,  we  should  emphasize  that  the  atomic  experiments  manipulate  pure  (or  nearly 
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pure)  quantum  states  whereas  the  liquid-state  NMR  research  described  above  generally  works 
with  so-called  effective  pure  states  [56].  Magnetic  resonance  experiments  with  low  temperature 
solid-state  samples  [57]  or  electron  spins  [58]  are  more  like  atomic  systems  in  this  regard. 

Finally,  we  wish  to  call  attention  to  a  new  class  of  experiments  on  atoms  in  optical  lattices. 
Optical  lattices  are  one-,  two-  or  three-dimensionally  ‘corrugated’  mechanical  potentials, 
created  by  laser  light,  that  can  be  used  to  modulate  the  motion  of  cold  atoms  and  even  confine 
them  in  crystalline  arrays.  The  interaction  between  the  laser  light  and  the  atomic  center-of- 
mass  motion  depends  generally  on  the  atomic  internal  state,  which  makes  optical  lattices  an 
interesting  setting  in  which  to  couple  these  quantized  degrees  of  freedom  [59]  (much  as  has  been 
done  with  trapped  ions).  Experiments  have  been  proposed  to  investigate  the  crossover  from 
chaotic  classical  dynamics  to  quantum  dynamics  in  such  systems  [60],  and  also  to  implement 
quantum  logic  gates  among  neighboring  atoms  in  the  lattice  [61,  62,  63,  32].  When  an  optical 
lattice  is  ‘loaded’  from  a  degenerate  quantum  gas,  such  as  an  atomic  Bose-Einstein  condensate, 
it  is  possible  to  observe  intriguing  quantum  phase  transitions  of  the  kind  that  have  long  been 
studied  in  condensed  matter  physics  [64,  65].  Theoretical  studies  have  begun  to  appear  on  the 
possibility  of  actively  controlling  these  quantum  phase  transitions  in  order  to  access  exotic 
atomic  collective  states  [66,  67]. 

3.3.  Solid-state  systems 

Solid-state  systems  provide  very  rich  dynamical  settings  for  the  investigation  of  quantum 
phenomena.  The  construction  of  accurate  theoretical  models  for  such  systems  can  be  quite 
challenging,  but  it  has  been  possible  to  achieve  excellent  agreement  with  experiments  in 
numerous  scenarios  of  interest  for  quantum  control.  Here  we  will  limit  our  attention  to  a 
brief  survey  of  some  specific  systems  that  were  discussed  at  the  PRACQSYS  workshop,  with  a 
selection  of  compatible  experimental  and  theoretical  references.  As  a  general  comment,  it  seems 
worthwhile  to  note  that  recent  work  on  quantum  control  of  solid  state  systems  strongly  suggests 
that  some  practical  limits  to  achievable  performance  will  derive  from  the  finite  temperature  of 
sensors  and  actuators;  this  is  an  unusual  and  interesting  ‘physical’  consideration  for  estimation 
and  control. 

Superconducting  circuits  incorporating  Cooper-pair  boxes  have  become  a  central  paradigm 
for  the  study  of  many-body  quantum  dynamics,  mesoscopic  physics  and  solid-state  realizations 
of  quantum  information  processing.  It  is  now  possible  to  produce  coherent  superpositions  of 
quantum  states  of  such  circuits,  to  observe  coherent  dynamical  evolution  in  them,  and  to 
perform  readout  with  high  fidelity  and  low  backaction  [68].  Open- loop  quantum  control  in 
superconducting  circuits  is  thus  reaching  a  level  of  maturity  comparable  to  that  of  trapped  ion 
systems,  although  the  decoherence  mechanisms  (residual  environmental  couplings)  are  much 
less  well  understood  and  the  achieved  control  fidelities  have  accordingly  been  substantially 
lower.  However,  superconducting  circuits  provide  access  to  a  broader  range  of  dynamical 
phenomena,  including  bifurcations  and  limit-cycle  behavior  for  quantized  effective  degrees 
of  freedom;  some  of  these  have  been  well  characterized  and  even  exploited  as  the  basis  for 
constructing  novel  quantum  amplifiers  [69].  Recently  it  has  become  possible  to  couple  Cooper- 
pair  boxes  to  high  quality  factor  microwave  resonators  [70],  leading  to  the  realization  of  ‘circuit 
QED’  systems  with  many  features  in  common  with  single-atom  cavity  QED  as  described  above. 
These  developments  have  opened  exciting  new  prospects  for  observing  conditional  evolution 
and  possibly  implementing  real-time  feedback  control  in  superconducting  circuits. 

Copyright  ©  2004  John  Wiley  &  Sons,  Ltd.  Int.  J.  Robust  Nonlinear  Control  2004;  0:0-0 

Prepared  using  rncauth.cls 


12 


H.  MABUCHI  AND  N.  KHANEJA 


Electron  spin  degrees  of  freedom  in  semiconductor  systems  can  likewise  serve  as  subjects  for 
quantum  control,  with  important  practical  applications  in  the  emerging  information  technology 
paradigm  of  ‘spintronics.’  Here  the  vision  is  to  utilize  electron  spin  (rather  than  charge)  as  the 
carrier  of  information  in  computer  circuitry,  with  concomitant  potential  gains  in  speed  and 
miniaturization.  One  possible  drawback  to  the  use  of  electron  spins  is  the  relative  difficulty 
of  implementing  control  mechanisms  to  change  their  states  rapidly  and  with  high  spatial 
selectivity.  By  analogy  with  NMR  experiments,  for  example,  one  would  think  of  using  pulsed 
magnetic  fields  to  manipulate  spins  but  this  would  be  very  difficult  to  do  with  the  required 
speeds  and  localization.  But  it  has  recently  been  demonstrated  that  one  can  instead  utilize 
the  effective  magnetic  fields  (due  to  the  relativistic  transformation  of  local  electric  fields)  seen 
by  electrons  moving  at  high  speed  through  a  strained  semiconductor  [71].  This  insight  could 
provide  the  basis  for  crucial  further  developments,  with  numerous  opportunities  for  control 
theoretic  analysis  and  design.  These  relativistic  effects  create  an  unusual  dynamical  coupling 
of  an  electron’s  spin  (intrinsic  angular  momentum)  to  its  linear  velocity,  which  should  be  quite 
interesting  to  study  from  the  perspective,  e.g.,  of  geometric  control. 

One  final  development  we  wish  to  mention  is  the  impressive  recent  progress  on  reaching 
a  quantum  regime  for  the  dynamics  of  nano-scale  mechanical  oscillators  [72,  73].  Here  the 
fabrication  of  sub-micron  scale  cantilevers  with  extremely  low  internal  dissipation  and  weak 
environmental  couplings,  combined  with  state-of-the-art  cryogenics  and  cryogenic  electro¬ 
mechanical  sensors,  has  made  it  possible  to  approach  conditions  in  which  quantum-mechanical 
behavior  of  the  cantilever  should  become  observable  and  controllable.  Initial  theoretical  studies 
have  been  conducted  of  the  feasibility  of  using  real-time  feedback  for  active  cooling  of  a 
cantilever  to  its  quantum  mechanical  ground  state  [74],  and  strategies  have  been  proposed 
and  analyzed  [75]  for  coupling  a  nano-mechanical  cantilever  to  a  Cooper-pair  box  to  provide 
an  alternative  solid-state  realization  of  dynamics  analogous  to  that  of  single-atom  cavity  QED. 


4.  Models  and  problems  arising  in  quantum  control 

The  applications  and  experimental  systems  described  above  have  given  rise  to  many  theoretical 
research  challenges  in  quantum  control.  Here  we  discuss  a  selection  of  them  and  provide 
references  to  relevant  publications. 

4.1.  Bilinear  and  Geometric  control  problems  in  Quantum  systems 

Active  control  of  quantum  dynamics  involves  systematically  changing  the  Hamiltonian  of 
the  quantum  system  by  suitably  tailored  electromagnetic  fields.  These  are  bilinear  control 
problems  (usually  with  drift)  involving  control  of  the  unitary  evolution  operator  U  evolving 
under  Schrodinger  equation  (ft  =  1) 

771 

U  =  -i[Hd  +  ^TujHj]U.  (2) 

i= 1 

Hd  is  the  internal  Hamiltonian  of  the  system  representing  couplings  between  various  degrees 
of  freedom  and  H}  are  the  Hamiltonians  resulting  from  external  excitations  which  are 
modulated  using  choice  of  control  Uj(t).  There  has  been  significant  interest  in  understanding 
the  controllability  properties  of  these  systems  [83,  99,  100,  101,  102,  103,  104],  both  when  the 
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quantum  system  (and  hence  (7)  is  finite  dimensional,  as  in  architechtures  of  coupled  spins  and 
in  cases  where  U  is  infinite,  as  arising  in  problems  ranging  from  control  of  cold  trapped  ions 
to  control  of  molecular  reactions  using  laser  fields  [38,  39,  103]. 

In  the  finite  dimensional  case,  results  on  controllability  of  these  systems  are  well  known 
from  classical  control  theory  [91,  92,  93]  and  captured  by  the  Lie  algebra  {—iH^—iH^LA 
generated  by  the  Hamiltonians  Hj  and  77,.  In  the  case  of  infinite-dimensional  bilinear  control 
systems,  many  conceptual  and  technical  difficulties  remain  [38,  39].  Controllability  arguments 
for  steering  infinite  dimensional  systems,  between  eigenstates  of  interest  have  been  primarily 
constructive  [96,  97].  There  has  been  a  recent  interest  in  understanding  controllability  of  infinite 
dimensional  quantum  systems  from  perspective  of  geometric  control  theory,  though  much 
work  remains  to  be  done.  Infinite  dimensional  bilinear  control  problems  also  arise  naturally  in 
the  context  where  one  is  trying  to  steer  an  ensemble  of  finite  dimensional  quantum  systems 
[87,  88,  89,  90].  These  problems  are  discussed  in  much  more  detail  in  the  following  section  4.3. 

Besides  questions  of  controllability,  in  practice,  the  complexity  of  synthesizing  excitations, 
that  produce  a  desired  evolution  of  a  quantum  system  is  of  great  interest.  In  general,  external 
excitations,  must  cooperate  with  evolution  under  the  intrinsic  Hamiltonian  Hd  to  synthesize 
a  desired  evolution  such  as  transferring  coherence  between  spins  in  context  of  magnetic 
resonance,  creation  of  entangled  states  or  synthesis  of  quantum  logic  between  coupled  quantum 
systems  [21].  This  reliance  on  internal  evolution  puts  a  fundamental  limit  on  the  amount  of 
time  it  takes  to  implement  a  desired  unitary  evolution  in  a  quantum  system.  This  is  a  known 
fact  in  control  theory.  For  controllable  nonlinear  systems  with  drift,  there  is  in  general  a 
minimum  time  to  steer  the  system  to  a  desired  point  even  in  the  presence  of  unbounded 
controls.  Characterizing  all  unitary  transformations  that  can  be  synthesized  in  a  given  time 
is  an  important  problem  related  to  the  design  of  time-optimal  excitations  for  bilinear  control 
systems  with  drift  [21,  22].  The  problems  are  of  practical  importance,  as  quantum  systems  of 
interest  are  rarely  isolated  from  their  environment.  Finding  time  optimal  methods  to  steer  the 
system  in  Eq.  2  between  points  of  interest  reduce  dissipative  effects  caused  by  interaction  with 
the  environment. 

Recent  study  of  these  time-optimal  control  problems  has  led  to  a  careful  study  of  the 
relationship  between  Lie  algebras  generated  by  control  Hamiltonians  t  =  {—iHj}iA  and 
the  full  control  algebra  0  =  {-iHd,  -iHj}ia  and  the  associated  groups  K  =  exp(t)  and 
G  —  exp(g)  [21],  The  time  required  to  synthesize  a  desired  evolution  in  Eq.  2  can  be  related 
to  control  systems  on  the  quotient  space  G/K.  A  satisfactory  theory  has  emerged  when  the 
quotient  space  G/K  is  a  Riemannian  symmetric  space  [21].  These  spaces  arise  naturally  in  the 
study  of  control  of  coupled  spin  1  [21,  22,  98]  in  context  of  magnetic  resonance  and  quantum 
information  processing.  In  this  case,  the  space  G  of  unitary  transformation  of  coupled  spins 
is  SU (4).  The  external  excitations  produce  local  unitary  transformations  in  the  subgroup 
K  =  57/(2)  ®  SU (2).  Analysis  of  the  resulting  control  systems  on  the  symmetric  space 
st/(2)®,s{/(2)  98)  108]  has  made  the  synthesis  of  unitary  transformations  for  coupled  spin  | 

or  qubits  transparent.  The  associated  Cartan  decomposition  of  5(7(4)  in  terms  of  the  subgroup 
5(7(2)®  5(7(2)  has  been  used  extensively  for  design  of  quantum  gates  in  quantum  information 
sciences  [83,  98,  109,  110,  111,  112].  Many  of  the  entanglement  generation  properties  of  the 
quantum  gates  can  be  studied  using  these  Cartan  decompositions  [112].  The  reachable  sets  and 
time  optimal  controls  in  Eq.  2  can  be  completely  characterized  when  G/K  is  a  Riemannian 
symmetric  space  [21],  Many  of  these  time  optimal  control  designs  have  been  experimentally 
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realized  in  the  context  of  magnetic  resonance  [80,  81]. 

The  geometric  control  methods  hold  promise  for  understanding  problems  of  optimal 
control  design  in  more  elaborate  scenarios  involving  networks  of  coupled  quantum  systems 
in  various  quantum  information  processing  architectures.  Many  of  these  optimal  control 
problems  reduce  to  the  study  of  subriemannian  geodesics  [94]  on  homogeneous  spaces  [22]. 
In  the  general  problem  of  control  of  a  network  of  coupled  spin  |,  the  control  subgroup 
K  =  SU (2)  ®  SU (2)  ®  . . .  SU (2)  of  local  unitary  transformations,  is  much  smaller  compared 
to  the  group  of  all  the  unitary  transformations  G  =  SU(2n).  Finding  efficient  ways  to  realize 
unitary  evolutions  in  a  network  of  coupled  quantum  systems  are  interesting  challenges  in 
the  geometric  control  of  practical  relevance.  For  infinite  dimensional  quantum  systems,  the 
problems  of  optimal  control  design  are  mainly  open  [39].  Besides  generation  of  specified 
unitary  evolutions,  there  are  important  time  optimal  control  problems  related  to  state  to 
state  transfer.  These  range  from  problems  of  optimal  synthesis  of  entanglement  and  transfer 
between  eigenstates  in  a  chain  of  trapped  ions  [38]  to  transfer  of  polarization  along  a  spin 
chain  [79]. 

Although  study  of  bilinear  control  systems  is  not  a  new  subject,  new  physical  problems  arising 
in  control  of  quantum  systems  motivate  rich  mathematical  structures.  These  problems  therefore 
provide  further  motivation  for  development  of  nonlinear  and  geometric  control  theory. 

Jf.2.  Optimal  Control  of  Quantum  Dynamics  in  the  Presence  of  Relaxation 

In  practice,  the  interaction  of  a  quantum  system  with  its  environment  makes  the  evolution  non¬ 
unitary  and  relaxes  the  system  back  to  its  equilibrium  state.  This  in  various  applications  leads 
to  loss  of  signal  and  information.  This  problem  of  relaxation  is  ubiquitous  in  applications 
involving  coherent  control  of  quantum  mechanical  phenomenon.  Manipulating  quantum 
systems  in  a  manner  that  minimizes  relaxation  losses  is  a  fundamental  challenge  of  practical 
importance. 

In  recent  years  there  has  been  significant  interest  in  the  development  of  the  techniques 
for  optimal  control  of  quantum  dynamics  in  presence  of  relaxation,  primarily  in  the  context 
of  magnetic  resonance  [23,  24,  25,  85,  86].  Most  of  the  work  in  this  area  has  focused  on 
applications,  where  the  environment  can  be  approximated  as  an  infinite  thermostat  and  the 
evolution  of  the  open  quantum  system  can  be  modeled  by  an  equation  of  the  Lindblad  type 
[77,  78] 


p  =  -i[Hd  +  Y^Uj(t)Hj(t),p]  +  L(p).  (3) 

3 

The  evolution  of  the  state  of  the  quantum  system  is  no  longer  unitary,  but  the  control  system 
still  retains  its  bilinear  structure  as  the  term  p  — >  L(p)  is  a  trace  preserving  linear  mapping. 

From  the  standpoint  of  control  theory,  these  are  interesting  challenges  related  to  the  control 
of  the  Lindblad  equation.  How  close  can  the  state  of  a  quantum  system  be  driven  to  its 
target  state?  What  is  the  maximum  sensitivity  one  can  expect  in  an  multidimensional  NMR 
experiment,  or  what  is  the  maximum  entanglement  that  can  be  synthesized  in  an  open  quantum 
system.  All  these  questions  are  directly  related  to  computing  the  reachable  sets  of  Lindblad 
equations.  In  high  resolution  NMR  experiments  significant  improvement  in  sensitivity  has  been 
reported  for  various  experiments  [25,  23,  24,  85,  86]  by  optimal  control  of  the  systems  as  in 
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Eq.  3.  There  has  also  been  some  recent  work  on  understanding  the  controllability  properties 
of  these  systems  [105]  from  a  mathematical  control  theory  perspective. 

To  fix  ideas,  we  present  a  model  problem  associated  with  optimal  control  of  coupled  spin 
dynamics  in  the  presence  of  relaxation  [24].  Given  the  control  system  [82] 
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with  k,J>  0,  the  objective  is  to  find  out  that  starting  with  the  state  (1,0, 0,0),  what  is  the 
maximum  achievable  value  of  x4  and  what  are  the  optimal  controls  u  and  v  that  achieve  this 
value.  Observe,  even  if  the  strength  of  controls  in  unbounded,  there  is  a  fundamental  limit  on 
the  maximum  value  of  x4. 

The  study  of  optimal  control  of  systems  of  the  above  kind  leads  to  new  class  of  constrained 
bilinear  control  systems  where  the  control  parameters  can  be  expressed  as  polynomial  functions 
of  fewer  parameters  [24,  82].  For  example,  consider  the  optimal  control  problem  of  finding  the 
largest  value  of  r2  that  can  be  reached  for  the  system 


d 

n  (*) 

—ku\ 

—  JU\U2 

'  n(t) 

dt 

r2(t) 

JU\U2 

—ku  j 

r2(t) 

starting  with  (n(0), r2(0))  =  (1,0),  where  controls  -1  <  u,  <  1.  Observe  the  controls  Uy  and 
u2  enter  quadratically  in  the  above  equation  5,  which  helps  us  to  analytically  solve  for  the 
optimal  control  [24], 

In  general,  these  problems  on  control  of  open  quantum  systems  then  motivate  the  study  of 
constraint  bilinear  control  problems,  of  the  following  form.  Let  x  £  R"  and  u  e  R7n.  Consider 
the  system 


x  =  (A  +  ^2  fi{u)Bi)x ,  (6) 

i 

where  fi(u)  is  a  polynomial  or  more  general  function  of  of  control  parameters  u.  Find  the 
reachable  set  of  such  a  system  starting  from  some  initial  state  x0-  Problems  of  optimal  control 
of  Lindblad  equations  also  arise  naturally  in  the  context  of  laser  cooling.  Recently,  these 
control  problems  have  been  studied  with  the  goal  of  finding  optimal  excitations  to  minimize 
the  entropy  of  a  quantum  system  [106,  107]. 

A  systematic  study  of  the  controllability  and  optimal  control  problems  related  to  Lindblad 
equations  of  open  quantum  systems  is  expected  to  have  immediate  impact  in  areas  of  coherent 
spectroscopy  and  quantum  information  processing. 

4.3.  Control  of  ensembles 

Many  applications  in  control  of  quantum  systems  involve  controlling  a  large  ensemble  by 
application  of  the  same  control.  In  practice,  the  elements  of  the  ensemble  could  show  variation 
in  their  physical  parameters  that  govern  the  dynamics  of  the  system.  For  example,  in  magnetic 
resonance  experiments,  the  spins  of  an  ensemble  may  have  large  dispersion  in  their  Larmor 
frequencies,  strength  of  couplings  between  coupled  spin  pairs  and  the  relaxation  rates  of  the 
spins.  In  solid  state  NMR  spectroscopy  of  powders,  the  random  distribution  of  orientations 
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of  inter-nuclear  vectors  of  coupled  spins  within  an  ensemble  lead  to  a  distribution  of  coupling 
strengths  [76].  A  canonical  problem  in  control  of  quantum  ensembles  is  to  develop  external 
excitations  that  can  simultaneously  steer  the  ensemble  of  systems  with  variation  in  their 
internal  parameters  from  an  initial  state  to  a  desired  final  state  [87,  88,  89,  90].  Prom  the 
standpoint  of  mathematical  control,  the  challenge  is  to  simultaneously  control  a  continuum  of 
systems  between  points  of  interest  with  the  same  control,  for  example  transfer  of  magnetization 
in  coupled  spin  ensemble  with  large  variations  in  the  Larmor  frequencies  and  coupling 
strengths. 

To  fix  ideas,  consider  the  following  bilinear  control  system  that  captures  the  dynamics  of  an 
ensemble  of  spin  |  is  external  magnetic  field  as  described  in  section  3.1. 

(7) 

Consider  now  the  problem  of  designing  controls  u(t)  and  v(t)  that  simultaneously  steers 
an  ensemble  of  such  systems  with  their  natural  frequency  u>  £  [— B,  B]  from  an  initial  state 
(x,y,  z)  =  (0,0, 1)  to  a  final  state  (x,  y,  z)  =  (1, 0,0)  [87].  This  problem  is  of  particular  interest, 
when  the  maximum  amplitude  of  the  applied  field  A(t)  =  yju2{t)  +  v2(t)  is  comparable  to  or 
less  than  the  bandwith  B  one  is  trying  to  cover  [87]. 

These  problems  raise  interesting  questions  about  controllability,  i.e  showing  that  there  exists 
a  control  law  ( u(t),v(t )  satisfying  ^ u2(t )  +  v2{t)  <  Amax  which  simultaneously  steers  all 
the  systems  with  <j  e  [— B,B]  to  a  ball  of  chosen  radius  around  the  final  state  (1,0,0)  in 
finite  time.  Furthermore,  practical  considerations  like  relaxation  as  described  in  section  3.1, 
make  it  desirable  to  construct  the  shortest  control  law  which  achieves  this  goal.  These  are 
problems  of  optimal  control  of  infinite  dimensional  systems  of  a  special  kind.  A  systematic 
study  of  these  systems  is  expected  to  have  immediate  applications  in  areas  of  coherent 
spectroscopy  and  control  of  quantum  systems  in  general.  Generalization  of  these  problems 
to  controllability  and  optimal  control  questions  related  to  the  problem  of  transferring  an 
initial  function  (x(u>,0),y(u),  0),z(w,0))  to  a  target  function  (x(u>,  T),y(u>,  T),  z(u>,  T))  by  an 
appropriate  choice  of  controls  in  Eq.  7  is  particularly  interesting  and  relevant  in  NMR  and  MRI 
applications.  In  this  context,  Eq.  7  can  be  interpreted  as  a  partial  differential  equation,  where 
the  functions  x(., .),  y{., .)  and  z(., .)  have  both  a  dependence  on  time  t  and  the  parameter  w. 
Therefore  these  problems  motivate  investigating  the  controllability  properties  of  bilinear  PDE 
models  of  the  form 


X 

0  —  u)  —au(t) 

X 

y 

= 

u>  0  av(t) 

y 

z 

au(t)  —av{t)  0 

z 

—  =  (  A{s)  +Y^Ui(t)Bi(s)  )x{s,t) 

i 

where  the  same  controls  iq(t)  are  being  used  to  simultaneously  steer  an  ensemble  of  control 
systems  indexed  by  the  control  parameter  s.  These  models  include  problems  in  which  the 
elements  of  an  ensemble  may  see  a  big  variation  in  the  control  field.  In  Eq.  7,  the  parameter 
a  might  show  a  distribution  in  a  €  [Amin,  Amax].  In  magnetic  resonance  applications,  this 
arises  when  different  spatial  positions  in  the  sample  experience  different  rf-fields  due  to  field 
inhomogeneities.  Control  designs  that  only  excite  parts  of  the  ensemble  with  their  parameter 
values  in  a  desired  region  and  leave  the  remaining  ensemble  undisturbed  are  desirable  in  NMR 
and  MRI  applications  [95]. 
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Another  class  of  problems  that  arise  often  in  the  control  of  quantum  ensembles  are  the  ones 
associated  with  the  optimization  of  certain  average  quantity  associated  with  the  ensemble. 
To  fix  ideas  again  consider  the  model  problem  of  optimal  state  transfer  in  the  presence  of 
relaxation  described  in  Eq.  4  in  section  4.2  [24].  Now  J  and  k  are  distributed  in  the  range 
(Ji,  J2)  and  (Aq,  fa)  respectively.  The  goal  is  to  design  u(t)  and  v(t)  that  maximize  the  average 
value  of  X4  over  all  the  systems  i.e  maximize 

rJi  /-fc2 

I  /  X4  (J,k,t)dJdk. 

JJi  Jkt 

In  summary,  problems  involving  simulataneous  control  of  a  continuum  of  systems  with 
dispersion  in  their  parameters  arise  naturally  in  control  of  quantum  ensembles.  These  problems 
have  received  little  in-depth  attention  in  the  past  in  control  theory.  The  classical  techniques 
for  studying  controllability  and  reachability  need  to  be  further  developed  to  understand  these 
highly  under  actuated  control  problems  of  infinite  dimensional  systems. 

4-4 ■  Quantum  probability ,  filtering  and  feedback 

The  models  considered  in  previous  sections  pertain  to  open-loop  control,  and  here  we  wish 
to  provide  a  brief  introduction  to  real-time  feedback  control  of  open  quantum  systems.  To 
begin  with  we  should  clarify  that  we  consider  setups  in  which  the  plant  is  an  open  quantum 
system  while  the  sensors,  controller  and  actuators  can  reasonably  be  modeled  as  classical 
devices.  (Scenarios  involving  quantum-mechanical  controllers  have  also  been  considered,  for 
example  by  S.  Lloyd  and  co-workers  [113].)  In  the  theory  of  real-time  feedback  control  of  open 
quantum  systems,  there  remains  a  distinction  between  state-  and  output-feedback  paradigms, 
but  care  must  be  taken  to  avoid  ‘improper’  applications  of  state-feedback  methodology.  (In 
principle  it  could  suffice  at  this  point  to  state  the  fact  that  quantum  physics  forbids  perfect 
and  complete  measurements  of  the  state  of  any  single  quantum  system,  but  we  will  attempt 
to  provide  a  more  operational  explanation.)  While  direct  state  feedback  can  of  course  be 
investigated  in  a  quantum  setting  as  a  purely  theoretical  exercise,  or  as  a  computational  tool 
for  the  design  of  open  loop  controls,  it  never  really  provides  a  faithful  representation  of  actual 
feedback  interconnection.  For  reasons  that  we  will  discuss  shortly,  quantum  feedback  control  is 
always  essentially  stochastic  and  one  must  generally  have  recourse  to  a  separation  principle.  In 
experimental  scenarios  with  low  measurement  sensitivity  (low  signal-to-noise  ratio),  the  sensor 
noise  can  be  so  dominated  by  ‘excess’  noise  that  the  state  estimator  never  converges  to  the 
level  of  intrinsic  quantum  uncertainties.  In  such  cases  the  filtering  problem  can  effectively  be 
treated  classically,  leading  for  example  to  certainty-equivalent  control  models  in  which  there 
is  quantum  dynamics  (in  the  response  of  the  system  to  applied  fields)  but  no  measurement 
backaction.  This  type  of  approach  is  formally  similar  to  state  feedback  and  is  in  fact  well- 
motivated  in  current  research  on  feedback  cooling  and  closed-loop  system  identification  of 
atomic  ensembles  [34,  114]. 

In  experimental  scenarios  with  high  measurement  sensitivity,  however,  it  is  crucial  to  utilize 
the  type  of  quantum  filtering  equations  that  have  been  derived  by  researchers  in  mathematical 
physics  [115]  and  quantum  optics  [116,  117].  (In  intriguing  recent  work,  M.  James  [118]  has 
also  derived  quantum  risk-sensitive  filtering  equations  that  could  be  utilized  for  the  design  and 
implementation  of  robust  feedback  controllers.)  These  equations  are  derived  by  considering  a 
‘physical’  account  of  the  continuous  measurement  of  an  open  quantum  system  ( e.g .,  a  cloud 
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of  atoms)  in  which  some  probe  field  ( e.g .,  a  laser  beam) — itself  a  quantum  system — is  coupled 
to  the  plant  via  Hamiltonian  dynamics  {e.g.,  electromagnetic  coupling  of  atoms  and  photons 
according  to  Maxwell’s  Equations).  This  dynamical  coupling  creates  correlations  between  the 
quantum  states  of  the  plant  and  the  probe,  such  that  a  subsequent  destructive  measurement 
of  the  probe  {e.g.,  photodetection  of  the  transmitted  laser  beam)  yields  some  information 
about  the  evolving  plant  state.  If  it  is  assumed  that  such  a  sequence  occurs  repeatedly 
in  coarse-grained  time  steps,  one  can  take  an  Ito-like  limit  to  obtain  stochastic  differential 
equations  (SDE’s)  for  propagating  a  recursive  estimate  of  the  plant  state.  It  is  important 
to  note  that  quantum  uncertainties  associated  with  the  probe  field  induce  some  degree  of 
unavoidable  randomness  in  the  measurement  {e.g.,  photodetector)  signals  and/or  the  probe- 
induced  perturbations  of  the  plant  evolution.  Because  of  the  quantum  nature  of  the  probe  field 
it  is  impossible  to  conduct  measurements  on  an  open  quantum  system  in  such  a  way  that  both  - 
the  sensor  noise  and  ‘measurement-induced  process  noise’  vanish,  and  it  is  also  impossible  to 
make  simultaneous  accurate  determinations  of  both  noises  ‘after  the  fact’  by  scrutinizing  the 
transmitted  probe  field.  (There  have  been  some  theoretical  investigations  [119,  120]  of  schemes 
in  which  an  optical  probe  beam  is  prepared  in  a  highly  ‘squeezed’  state  to  suppress  sensor  noise, 
while  photodetection  and  feedback  are  used  to  cancel  the  measurement-induced  process  noise, 
but  at  present  they  are  practically  infeasible.)  The  use  of  proper  quantum  filtering  equations  in 
the  design  and  analysis  of  quantum  feedback  systems  is  thus  crucial  to  ensure  full  compliance 
with  subtle  physical  constraints  on  achievable  performance. 


While  it  remains  an  outstanding  research  challenge  to  derive  and  to  validate  quantum 
filtering  equations  for  solid-state  quantum  control  systems,  they  are  known  with  confidence 
for  many  systems  in  atomic  physics  including  single-atom  cavity  QED  [121]  and  hyperfine 
spin  dynamics  in  atomic  ensembles  [122],  Such  stochastic  master  equations  (as  they  are 
known  in  quantum  optics  and  atomic  physics)  have  been  used  for  numerical  investigations 
of  proposed  quantum  feedback  schemes  [47,  123]  and  also  provide  a  starting  point  for  rigorous 
analyses.  Some  scenarios  of  great  practical  interest,  such  as  feedback  control  of  atomic  spin¬ 
squeezing  [54]  and  closed-loop  magnetometry  [10],  fall  into  a  class  of  quantum  Linear  Quadratic 
Gaussian  (LQG)  systems  for  which  exact  analytic  treatments  are  possible  [124,  125].  For  these 
systems  the  quantum  filtering  equations  can  be  used  to  derive  closed  sets  of  SDE’s  for  the 
first  and  second  moments  of  a  quorum  of  quantum  variables.  These  SDE’s  can  be  put  in  the 
form  of  Kalman  filters  [126]  and  the  usual  LQG  analyses  from  classical  control  theory  apply 
straightforwardly.  In  such  LQG  quantum  control  models  the  only  signature  of  the  underlying 
quantum  mechanics  lies  in  the  fact  that  certain  inequalities  must  be  observed  among  gain  and 
covariance  matrices  therein;  hence  quantum  LQG  models  are  in  a  sense  a  subset  of  all  possible 
classical  LQG  models  [125]. 


Beyond  the  LQG  regime  it  becomes  difficult  to  obtain  exact  results,  although  some  recent 
progress  has  been  made  on  applying  stochastic  global  [26]  and  almost-global  [127]  stability 
methods  to  solve  stabilization  problems  in  systems  of  low  dimension.  The  basic  state  of 
affairs  in  nonlinear  quantum  control  reflects  the  relatively  underdeveloped  state  of  nonlinear 
stochastic  classical  control,  and  one  hopes  that  quantum  systems  will  provide  new  impetus  for 
a  reinvigoration  of  the  latter  field  as  well. 
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4-5.  Quantum  system  identification 

As  mentioned  above,  the  problem  of  determining  the  structure  of  a  protein  using  NMR  is 
an  example  of  what  engineers  might  call  a  system  identification  problem.  Applications  in 
quantum  metrology  (such  as  magnetic  field  detection  or  inertial  sensing)  may  also  be  viewed 
in  a  system  identification  framework.  System  identification  problems  have  been  widely  studied 
in  the  field  of  automatic  control  because  the  design  of  an  effective  feedback  control  system 
begins  with  an  accurate  model,  and  because  the  use  of  open-  or  closed-loop  controls  can  often 
improve  identification  accuracy  or  speed.  Quantum  system  identification  problems  present  new 
mathematical  structure  and  optimization  criteria  because  of  the  nature  of  the  dynamics,  some 
novel  technical  constraints,  and  the  types  of  measurement  backaction  issues  described  in  the 
preceding  section. 

It  is  useful  to  distinguish  between  quantum  system  identification  procedures  that  are  ‘single¬ 
shot’  versus  those  that  employ  an  sequence  of  measurements  on  a  fixed  apparatus.  As  an 
example  of  the  former  type  of  problem,  we  refer  back  to  our  previous  mention  of  LQG  quantum 
feedback  control  on  atomic  systems  [54],  It  is  possible  to  formulate  extended  Kalman  filters 
for  such  scenarios,  in  which  one  or  more  parameters  appearing  in  the  Hamiltonian  are  treated 
as  static  or  dynamic  variables  to  be  estimated  from  a  continuous  measurement  signal.  Some 
general  investigations  have  appeared  on  the  sensitivity  and  optimization  of  such  procedures 
(including  analytic  studies  in  the  Gaussian  framework  and  numerical  studies  allowing  more 
general  likelihood  functions)  [128,  129,  130].  A  thorough  analysis  has  been  performed  of  using 
this  strategy  for  broadband  magnetometry  with  atoms  [10],  and  it  has  been  shown  that  real¬ 
time  feedback  can  be  exploited  for  significant  gains  in  robustness.  Generally  speaking  it  seems 
that  closed-loop  single-shot  procedures  provide  an  ideal  approach  to  estimating  non-stationary 
system  parameters  robustly. 

While  single-shot  procedures  will  presumably  become  more  prevalent  in  the  future  (with 
high-profile  applications  such  as  LIGO),  most  quantum  system  identification  problems 
considered  to  date  are  based  on  the  statistical  analysis  of  a  series  of  measurements  on  a 
fixed  apparatus.  The  existing  literature  on  classical  system  identification  is  almost  exclusively 
devoted  to  problems  for  which  the  choice  of  input  can  be  decoupled  from  the  identification 
problem.  But  with  insensitive  techniques  such  as  NMR,  for  which  measurement  time  is 
precious,  the  design  of  input  signals  that  reduce  the  time  required  for  system  identification  is 
extremely  important.  Some  recent  work  in  this  area  [131]  examines  the  problem  of  determining 
a  good  probing  signal  for  system  identification  as  a  problem  in  minimizing  the  entropy  of  the 
probability  density  for  the  parameter  values,  given  the  observations  [131].  This  results  in 
a  mathematical  formulation  of  the  optimal  input  problem,  that,  at  least  in  principle,  has  a 
solution  that  defines  best  input  sequences  or  family  of  sequences  that  lead  to  efficient  reduction 
of  uncertainty  in  system  parameters.  (Note  that  in  the  literature  of  quantum  information 
theory,  this  type  of  problem  has  been  labeled  ‘quantum  process  tomography.’) 

The  problems  of  Hamiltonian  identification  also  arise  in  other  applications  of  quantum 
control.  As  mentioned  above,  there  is  now  extensive  experimental  work  on  using  closed  loop 
methods  for  design  of  laser  excitations  in  control  of  molecular  reactions.  These  methods  use 
stochastic  search  techniques,  including  genetic  algorithms  to  learn  control  designs  that  optimize 
the  final  yield  of  the  experiment  [132,  133,  134].  Many  of  these  problems  could  benefit  by  a 
systematic  development  of  techniques  of  system  identification  for  Hamiltonian  estimation. 

A  complementary  problem  to  system  identification  that  often  arises  in  quantum  contexts  is 
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that  of  state  reconstruction.  The  basic  challenge  is  to  derive  an  optimal  measurement  [135]  or 
(possibly  adaptive)  sequence  [114]  of  measurements  to  be  performed  on  one  or  more  ‘copies’  of  a 
quantum  state  in  order  to  identify  it  as  quickly  and  as  accurately  as  possible.  This  identification 
make  have  any  prior  over  a  discrete  or  continuous  set  of  possible  states.  The  problem  is  clearly 
related  to  observability  on  one  hand  and  communication  theory  on  the  other,  providing  an 
interesting  possible  point  of  contact  between  control  theory  and  quantum  networks  [136]. 


5.  Conclusions 

There  are  now  a  number  of  quantum  control  systems  for  which  basic  theory  is  in  place  and 
experiment  has  reached  an  advanced  stage  of  development.  The  study  of  these  systems  in 
control-theoretic  terms  will  be  important  for  a  wide  range  of  strategic  applications.  Broader 
engagement  by  the  controls  community  could  be  exceptionally  fruitful  at  this  time,  as  could  be 
the  training  of  physicists  with  deeper  knowledge  of  estimation,  control  and  dynamical  systems 
theories  from  engineering.  Quantum  control  provides  a  unique  opportunity  for  reexamining 
the  physical  basis  of  control  and  estimation  theory,  and  may  ultimately  shed  new  light  on 
fundamental  issues  in  quantum  physics  as  well. 


REFERENCES 


1.  V.  P.  Belavkin,  “Theory  of  the  control  of  observable  quantum-systems,”  Automation  and  Remote  Control 
44,  178  (1983);  also  available  as  quant-ph/0408003. 

2.  A.  P.  Peirce,  M.  A.  Dahleh  and  H.  Rabitz,  “Optimal-control  of  quantum-mechanical  systems  -  existence, 
numerical  approximation,  and  applications,”  Phys.  Rev.  A  37,  4950-4964  (1988). 

3.  G.  M.  Huang,  T.  J.  Tarn  and  J.  W.  Clark,  “On  the  controllability  of  quantum-mechanical  systems,”  J. 
Math.  Phys.  24,  2608-2618  (1983). 

4.  J.  Preskill,  “Reliable  quantum  computers,”  Proc.  Roy.  Soc.  London  A  454  385-410  (1998). 

5.  A.  M.  Steane,  “Overhead  and  noise  threshold  of  fault-tolerant  quantum  error  correction,”  Phys.  Rev.  A 
68,  042322  (2003). 

6.  B.  Rahn,  A.  C.  Doherty  and  H.  Mabuchi,  “Exact  performance  of  concatenated  quantum  codes,”  Phys. 
Rev.  A  66,  032304  (2002). 

7.  K.  Khodjasteh  and  D.  A.  Lidar,  “Concatenated  dynamical  decoupling,”  quant-ph/0408128  (2004). 

8.  J.  Fern,  J.  Kempe,  S.  Simic  and  S.  Sastry,  “Fault-tolerant  quantum  computation  -  a  dynamical  systems 
approach,"  quant-ph/0409084  (2004). 

9.  M.  A.  Armen,  J.-K.  Au,  J.  K.  Stockton,  A.  C.  Doherty  and  H.  Mabuchi,  “Adaptive  homodyne  measurement 
of  optical  phase,”  Phys.  Rev.  Lett.  89,  133602  (2002). 

10.  J.  K.  Stockton,  JM  Geremia,  A.  C.  Doherty  and  H.  Mabuchi,  “Robust  quantum  parameter  estimation: 
coherent  magnetometry  with  feedback,”  Phys.  Rev.  A  69,  032109  (2004). 

11.  T.  L.  Gustavson,  A.  Landragin  and  M.  A.  Kasevich,  “Rotation  sensing  with  a  dual  atom-interferometer 
Sagnac  gyroscope,”  Classical  and  Quantum  Gravity  17,  2385-2398  (2000). 

12.  J.  M.  McGuirk,  G.  T.  Foster,  J.  B.  Fixler,  M,  J.  Snadden  and  M.  A.  Kasevich,  “Sensitive  absolute-gravity 
gradiometry  using  atom  interferometry,”  Phys.  Rev.  A  65,  033608  (2002). 

13.  A.  Buonanno,  Y.  B.  Chen  and  N.  Mavalvala,  “Quantum  noise  in  laser-interferometer  gravitational-wave 
detectors  with  a  heterodyne  readout  scheme,”  Phys.  Rev.  D  67,  122005  (2003). 

14.  H.  Rabitz,  R.  de  Vivie-Riedle,  M.  Motzkus  and  K.  Kompa,  “Chemistry  -  whither  the  future  of  controlling 
quantum  phenomena?”  Science  288,  824-828  (2000). 

15.  H.  Rabitz,  “Tying  the  loop  tighter  around  quantum  systems,”  J.  Mod.  Opt.  50,  2291-2303  (2003). 

16.  R.  J.  Levis,  G.  M.  Menkir  and  H.  Rabitz,  “Selective  bond  dissociation  and  rearrangement  with  optimally 
tailored,  strong-field  laser  pulses,”  Science  292,  709-713  (2001). 

17.  J.  L.  Herek,  W.  Wohleben,  R.  J.  Cogdell,  D.  Zeidler  and  M.  Motzkus,  “Quantum  control  of  energy  flow 
in  light  harvesting,”  Nature  417,  533-535  (2002). 


Copyright  ©  2004  John  Wiley  &  Sons,  Ltd. 
Prepared  using  rncauth.ds 


Int.  J.  Robust  Nonlinear  Control  2004;  0:0-0 


PRACQSYS’04 


21 


18.  I.  P.  Christov,  R.  Bartels,  H.  C.  Kapteyn  and  M.  M.  Murnane,  “Attosecond  time-scale  intra-atomic  phase 
matching  of  high  harmonic  generation,”  Phys.  Rev.  Lett.  86,  5458-5461  (2001). 

19.  JM  Geremia  and  H.  Rabitz,  “Optimal  identification  of  Hamiltonian  information  by  closed-loop  laser  control 
of  quantum  systems,”  Phys.  Rev.  Lett.  89,  263902  (2002). 

20.  B.  Q.  Li,  G.  turinici,  V.  Ramakrishna  and  H.  Rabitz,  “Optimal  dynamic  discrimination  of  similar  molecules 
through  quantum  learning  control,”  J.  Phys.  Chem.  B  106,  8125-8131  (2002). 

21.  N.  Khaneja,  R.  W.  Brockett  and  S.  J.  Glaser,  “Time  Optimal  Control  of  Spin  Systems,”  Phys.  Rev.  A  63, 
032308  (2001). 

22.  N.  Khaneja,  S.  J.  Glaser  and  R.  W.  Brockett,  “Sub-Riemannian  geometry  and  optimal  control  of  three 
spin  systems,”  Phys.  Rev.  A,  65,  032301  (2002). 

23.  N.  Khaneja,  B.  Luy,  and  S.  J.  Glaser,  “Boundary  of  Quantum  Evolution  under  Decoherence,”  Proc.  Nat. 
Acad.  Sci.  USA  100,  13162-66  (2003). 

24.  N.  Khaneja,  T.  Reiss,  B.  Luy,  S.  J.  Glaser,  "Optimal  Control  of  Spin  Dynamics  in  the  Presence  of 
Relaxation,”  J.  Magn.  Reson.  162,  311-319  (2003). 

25.  N.  Khaneja,  Jr.  Shin  Li,  C.  Kehlet,  B.  Luy,  S.  J.  Glaser,  “Broadband  Relaxation  Optimized  Polarization 
TYansfer  in  Magnetic  Resonance,”  Proc.  Nat.  Acad.  Sci.  USA  101,  14742-47  (2004). 

26.  R.  van  Handel,  J.  K.  Stockton  and  H.  Mabuchi,  “Feedback  control  of  quantum  state  reduction,”  quant- 
ph/0402136  (2004). 

27.  R.  R.  Ernst,  G.  Bodenhausen,  A.  Wokaun,  Principles  of  Nuclear  Magnetic  Resonance  in  One  and  Two 
Dimensions  (Clarendon  Press,  Oxford,  1987). 

28.  C.  P.  Slichter,  Principles  of  Magnetic  Resonance  (Springer  Verlag  1978). 

29.  A.  Abragam,  The  Principles  of  Nuclear  Magnetism  (Oxford  University  Press  1978). 

30.  K.  Wuthrich,  NMR  of  Proteins  and  Nucleic  Acids  (Wiley  &  Sons  1986). 

31.  J.  Cavanagh  and  W.  J.  Fairbrother  and  A.  G.  Palmer  and  N.  J.  Skelton,  Protein  NMR  Spectroscopy, 
Principles  and  Practice  (Academic  Press,  1996). 

32.  T.  Calarco,  U.  Dorner,  P.  S.  Julienne,  C.  J.  Williams  and  P.  Zoller,  “Quantum  computations  with  atoms 
in  optical  lattices:  Marker  qubits  and  molecular  interactions,”  Phys.  Rev.  A  70,  012306  (2004). 

33.  I.  Roos  and  K.  Mplmer,  “Quantum  computing  with  an  inhomogeneously  broadened  ensemble  of  ions: 
Supression  of  errors  from  detuning  variations  by  specially  adpated  pulses  and  coherent  population 
trapping,”  Phys.  Rev.  A  69,  022321  (2004). 

34.  N.  V.  Morrow,  S.  K.  Dutta  and  G.  Raithel,  “Feedback  control  of  atomic  motion  in  an  optical  lattice,” 
Phys.  Rev.  Lett.  88,  093003  (2002). 

35.  V.  Vuletic,  A.  T.  Black  and  J.  K.  Thompson,  “External-feedback  laser  cooling  of  gases,”  quant-ph/0410168 
(2004). 

36.  U.  Tanaka,  J.  C.  Bergquist,  S.  Bize,  S.  A.  Diddams,  R.  E.  Drullinger,  L.  Hollberg,  W.  M.  Itano,  C.  E.  Tanner 
and  D.  J.  Wineland,  “Optical  frequency  standards  based  on  the  Hg-199(+)  ion,"  IEEE  Transactions  on 
Instrumentation  and  Measurement  52,  245-249  (2003). 

37.  D.  J.  Wineland,  M.  Barrett,  J.  Britoon,  J.  Chiaverini,  B.  DeMarco,  W.  M.  Itano,  B.  Jelenkovic,  C.  Langer, 
D.  Leibfried,  V.  Meyer,  T.  Rosenband  and  T.  Schatz,  “Quantum  information  processing  with  trapped  ions,” 
Philosophical  Transaction  of  the  Royal  Society  of  London  A  361,  1349-1361  (2003). 

38.  C.  Rangan,  A.  M.  Bloch,  C.  Monroe  and  P.  H.  Bucksbaum,  “Control  of  TYapped  Ion  Quantum  States 
with  Optical  Pulses”,  Phys.  Rev.  Lett.  92,  113004,  (2004). 

39.  R.  Brockett,  C.  Rangan  and  A.  M.  Bloch,  Controllability  of  Infinite  Dimensional  Quantum  Systems, 
Proceedings  of  Conference  on  Decision  and  Contro,  Hawaii,  (2004). 

40.  G.  R.  Guthorhrlein,  M.  Keller,  K.  Hayasaka,  W.  Lange  and  H.  Walther,  “A  single  ion  as  a  nanoscopic 
probe  of  an  optical  field,”  Nature  414,  49-51  (2002). 

41.  A.  B.  Mundt,  A.  Kreuter,  C.  Becher,  D.  Leibfried,  J.  Eschner,  F.  Schmidt-Kaler  and  R.  Blatt,  “Coupling 
a  single  atomic  quantum  bit  to  a  high  finesse  optical  cavity,”  Phys.  Rev.  Lett.  89,  103001  (2002). 

42.  P.  R.  Berman,  Ed.,  Cavity  Quantum  Electrodynamics  (Academic  Press,  San  Diego,  1994). 

43.  J.-M.  Raimond,  M.  Brune  and  S.  Haroche,  “Colloquium:  Manipulating  quantum  entanglement  with  atoms 
and  photons  in  a  cavity,”  Rev.  Mod.  Phys.  73,  565-582  (2001). 

44.  H.  Walther,  “Quantum  phenomena  of  single  atoms,”  Advances  in  Chemical  Physics  122,  167-197  (2002). 

45.  H.  Mabuchi  and  A.  C.  Doherty,  “Cavity  quantum  electrodynamics:  Coherence  in  context,”  Science  298, 
1372-1377  (2002). 

46.  J.  McKeever,  A.  Boca,  A.  D.  Boozer,  R.  Miller,  J.  R.  Buck,  A.  Kuzmich  and  H.  J.  Kimble,  “Deterministic 
generation  of  single  photons  from  one  atom  trapped  in  a  cavity,”  Science  303,  1992-1994  (2004). 

47.  D.  A.  Steck,  K.  Jacobs,  H.  Mabuchi,  T.  Bhattacharya  and  S.  Habib,  “Quantum  feedback  control  fo  atomic 
motion  in  an  optical  cavity,”  Phys.  Rev.  Lett.  92,  223004  (2004). 

48.  J.  E.  Reiner,  H.  M.  Wiseman  and  H.  Mabuchi,  “Quantum  jumps  between  dresssed  states:  a  proposed 
cavity-QED  test  using  feedback,”  Phys.  Rev.  A  67,  042106  (2003). 

49.  H.  Mabuchi,  “Quantum  feedback  and  the  quantum-classical  transition,”  in  Science  and  Ultimate  Reality: 


Copyright  ©  2004  John  Wiley  &  Sons,  Ltd. 
Prepared  using  rncauth.ds 


Int.  J.  Robust  Nonlinear  Control  2004;  0:0-0 


22 


H.  MABUCHI  AND  N.  KHANEJA 


Quantum  Theory,  Cosmology  and  Complexity  (Cambridge  University  Press,  Cambridge,  2004). 

50.  M.  Bajcsy,  A.  S.  Zibrov  and  M.  D.  Lukin,  “Stationary  pulses  of  light  in  an  atomic  medium,”  Nature  426, 
638-641  (2003). 

51.  B.  Julsgaard,  J.  Sherson,  J.-I.  Cirac,  J.  Fiurasek  and  E.  S.  Polzik,  “Experimental  demonstration  of  a 
quantum  memory  for  light,”  Nature  432,  482-486  (2004). 

52.  C.-W.  Chou,  S.  V.  Polyakov,  A.  Kuzmich  and  H.  J.  Kimble,  “Single-photon  generation  from  stored 
excitation  in  an  atomic  ensemble,”  Phys.  Rev.  Lett.  92,  213601  (2004). 

53.  D.  Felinto,  L.  H.  Acioli  and  S.  S.  Vianna,  “Temporal  coherent  control  of  a  sequential  transition  in  rubidium 
atoms,”  Opt.  Lett.  25,  917-919  (2000). 

54.  JM  Geremia,  J.  K.  Stockton  and  H.  Mabuchi,  “Real-time  quantum  feedback  control  of  atomic  spin¬ 
squeezing,”  Science  304,  270  (2004). 

55.  N.  P.  Georgiades,  E.  S.  Polzik  and  H.  J.  Kimble,  “Frequency  metrology  by  use  of  quantum  interference," 
Opt.  Lett.  21,  1688-1690  (1996). 

56.  I.  L.  Chuang,  N.  Gershenfeld,  M.  G.  Kubinec  and  D.  W.  Leung,  “Bulk  quantum  computation  with  nuclear 
magnetic  resonance:  theory  and  experiment,”  Proc.  Roy.  Soc.  London  A  454,  447-467  (1998). 

57.  G.  S.  Boutis,  D.  Greenbaum,  H.  Cho,  D.  G.  Cory  and  C.  Ramanathan,  “Spin  diffusion  of  correlated 
two-spin  states  in  a  dielectric  crystal,”  Phys.  Rev.  Lett.  92,  137201  (2004). 

58.  V.  Sih,  W.  H.  Lau,  R.  C.  Myers,  A.  C.  Gossard,  M.  E.  Flatte  and  D.  D.  Awschalom,  “Control  of  electron- 
spin  coherence  using  Landau  level  quantization  in  a  two-dimensional  electron  gas,”  Phys.  Rev.  B  70, 
161313  (2004). 

59.  I.  H.  Deutsch  and  P.  S.  Jessen,  “Quantum-state  control  in  optical  lattices,”  Phys.  Rev.  A  98,  1972-1986 
(1998). 

60.  S.  Ghose,  P.  M.  Alsing  and  I.  H.  Deutsch,  “Atomic  motion  in  magneto-optical  double-well  potentials:  A 
testing  ground  for  quantum  chaos,”  Phys.  Rev.  E  64,  056119  (2001). 

61.  G.  K.  Brennen,  C.  M.  Caves,  P.  S.  Jessen  and  I.  H.  Deutsch,  “Quantum  logic  gates  in  optical  lattices,” 
Phys.  Rev.  Lett.  82,  1060-1063  (1999). 

62.  T.  Calarco,  E.  A.  Hinds,  D.  Jaksch,  J.  Schmiedmayer,  J.-I.  Cirac  and  P.  Zoller,  “Quantum  gates  with 
neutral  atoms:  Controlling  colllisional  interactions  in  time-dependent  traps,”  Phys.  Rev.  A  61,  022304 
(2000). 

63.  T.  Rom,  T.  Best,  O.  Mandel,  A.  Widera,  M.  Greiner,  T.  W.  Hansch  and  I.  Bloch,  “State  selective 
production  of  molecules  in  optical  lattices,”  Phys.  Rev.  Lett.  93,  073002  (2004). 

64.  B.  Paredes,  A.  Widera,  V.  Murg,  O.  Mandel,  S.  Foiling,  J.-I.  Cirac,  G.  V.  Shlyapnikov,  T.  W.  Hansch  and 
I.  Bloch,  “Tonks-Girardeau  gas  of  ultracold  atoms  in  an  optical  lattice,”  Nature  429,  277-281  (2004). 

65.  D.  Jaksch,  C.  Bruder,  J.-I.  Cirac,  C.  W.  Gardiner  and  P.  Zoller,  “Cold  bosonic  atoms  in  optical  lattices,” 
Phys.  Rev.  Lett.  81,  3108  (1998). 

66.  J.-I.  Cirac,  M.  Lewenstein,  K.  Maimer  and  P.  Zoller,  “Quantum  superposition  states  of  Bose-Einstein 
condensates,”  Phys.  Rev.  A  57,  1208-1218  (1998). 

67.  L.-M.  Duan,  E.  Demler  and  M.  D.  Lukin,  “Controlling  spin  exchange  interactions  of  ultracold  atoms  in 
optical  lattices,”  Phys.  Rev.  Lett.  91,  090402  (2003). 

68.  K.  K.  Berggren,  “Quantum  computing  with  superconductors,”  Proc.  IEEE  92,  1630-1638  (2004). 

69.  I.  Siddiqi,  R.  Vijay,  F.  Pierre,  C.  M.  Wilson,  M.  Metcalfe,  C.  Rigetti,  L.  Frunzio  and  M.  H.  Devoret,  “RF- 
driven  Josephson  bifurcation  amplifier  for  quantum  measurement,”  Phys.  Rev.  Lett.  93,  207002  (2004). 

70.  A.  Wallraff,  D.  I.  Schuster,  A.  Blais,  L.  FVunzio,  R.  S.  Huang,  J.  Mayer,  S.  Kumar,  S.  M.  Girvin  and 
R.  J.  Schoelkopf,  “Strong  coupling  of  a  single  photon  to  a  superconducting  qubit  using  circuit  quantum 
electrodynamics,”  Nature  431,  162-167  (2004). 

71.  Y.  Kato,  R.  C.  Myers,  A.  C.  Gossard  and  D.  D.  Awschalom,  “Coherent  spin  manipulation  without  magnetic 
fields  in  strained  semiconductors,”  Nature  427,  50-53  (2004). 

72.  X.  M.  H.  Huang,  C.  A.  Zorman,  M.  Mehregany  and  M.  L.  Roukes,  “Nanoelectromechanical  systems: 
Nanodevice  motion  at  microwave  frequencies,”  Nature  421,  496  (2003). 

73.  M.  D.  LaHaye,  O.  Buu,  B.  Camarota  and  K.  C.  Schwab,  “Approaching  the  quantum  limit  of  a 
nanomechanical  resonator,”  Science  304,  74-77  (2004). 

74.  A.  Hopkins,  K.  Jacobs,  S.  Habib  and  K.  Schwab,  “Feedback  cooling  of  a  nanomechanical  resonator,”  Phys. 
Rev.  B  68,  235328  (2003). 

75.  A.  D.  Armour,  M.  P.  Blencowe  and  K.  C.  Schwab,  “Entanglement  and  decoherence  of  a  micromechanical 
resonator  via  coupling  to  a  Cooper-pair  box,”  Phys.  Rev.  Lett.  88,  148301  (2002). 

76.  K.  Rohr  and  M.  Speiss,  Multidimsional  Solid  State  NMR  of  Polymers  (Academic  Press,  1994). 

77.  A,  G.  Redfield,  “The  theory  of  relaxation  processes,”  Adv.  Magn.  Reson.  1,  1-32  (1965). 

78.  G.  Lindblad,  “On  the  generators  of  quantum  dynamical  semigroups,”  Commun.  Math.  Phys.  48,  199 
(1976)  . 

79.  N.  Khaneja,  S.  J.  Glaser,  ’’Efficient  transfer  of  coherence  through  Ising  Spin  chains,”  Phys.  Rev.  A.  66, 
06030 1(R)  (2002). 


Copyright  ©  2004  John  Wiley  &  Sons,  Ltd. 
Prepared  using  rncauth.ds 


Int.  J.  Robust  Nonlinear  Control  2004;  0:0-0 


PRACQSYS’04 


23 


80.  T.  Reiss,  N.  Khaneja  and  S.  J.  Glaser,  “Time-Optimal  Coherence-Order-Selective  Transfer  of  In-Phase 
Coherence  in  Heteronuclear  IS  Spin  Systems,”  J.  Magn.  Reson.  154,  192-195  (2002). 

81.  N.  Khaneja,  F.  Kramer  and  S.  J.  Glaser,  “Optimal  experiments  for  maximizing  coherence  transfer  between 
coupled  spins,”  J.  Magn.  Reson.  in  Press. 

82.  N.  Khaneja,  S.  J.  Glaser,  “  Constrained  Bilinear  Systems,” Proc.  IEEE  Conference  on  Decision  and  Control 

(2002). 

83.  N.  Khaneja  and  S.  J.  Glaser,  “Cartan  decomposition  of  SU{2n )  and  control  of  spin  systems”,  Chem.  Phys. 
267,  11-23,  (2001). 

84.  S.  Dionisis,  N.  Khaneja,  S.  J.  Glaser,  “Optimal  control  of  spin  dynamics  in  the  presence  of  longitudinal 
and  transverse  relaxation,”  Phys.  Rev.  A  69,  022319  (2004). 

85.  N.  Khaneja,  S.  J.  Glaser,  “Optimal  Control  of  Coupled  Spins  in  presence  of  cross-correlated  relaxation,” 
Proceedings  of  IEEE  Conference  on  Decision  and  Control  (2003). 

86.  S.  Dionisis,  N.  Khaneja,  S.  J.  Glaser,  “Optimal  control  of  coupled  spins  in  the  presence  of  longitudinal 
and  transverse  relaxation,”  IEEE  Conference  on  Physics  and  Control,  St.  Petersburg,  Russia  (2003). 

87.  T.  E.  Skinner,  T.  Reiss,  B.  Luy,  N.  Khaneja,  S.  J.  Glaser,  “Application  of  optimal  control  theory  to  the 
design  of  broadband  excitation  pulses  for  high  resolution  NMR,”  J.  Magn.  Reson.  163,  8-15  (2003). 

88.  K.  Kobzar,  T.  E.  Skinner,  N.  Khaneja,  S.  J.  Glaser,  B.  Luy,  “Exploring  the  Limits  of  Broadband  Excitation 
and  Inversion  Pulses,”  J.  Magn.  Reson.  170,  236-243  (2004). 

89.  C.  T.  Kehlet,  A.  C.  Sivertsen,  M.  Bjerring,  T.  O.  Reiss,  N.  Khaneja,  S.  J.  Glaser,  N.  C.  Nielsen,  “Improving 
Solid-State  NMR  Dipolar  Recoupling  by  Optimal  Control,”  J.  Am.  Chem.  Soc.  ,  126,  10202-03  (2004). 

90.  T.  E.  Skinner,  T.  O.  Reiss,  B.  Luy,  N.  Khaneja,  S.  J.  Glaser, “Reducing  the  Duration  of  Broadband 
Excitation  Pulses  Using  Optimal  Control  with  Limited  RF  Amplitude,”  J.  Magn.  Reson.,  167,  68-74 
(2004). 

91.  R.  W.  Brockett,  “System  Theory  on  Group  Manifolds  and  Coset  Spaces,”  SIAM  Journal  of  Control,  10: 
265-284  (1972) 

92.  V.  Jurdjevic  and  H.  Sussmann,  “Control  Systems  on  Lie  Groups,”  Journal  of  Differential  Equations,  12: 
313-329  (1972). 

93.  R.  W.  Brockett,  “Nonlinear  Control  Theory  and  Differential  Geometry,”  Proceedings  of  the  International 
Congress  of  Mathematicians,  1357-1367,  (1984). 

94.  R.  W.  Brockett,  “Control  Theory  and  Singular  Riemannian  Geometry,”  in  New  Directions  in  Applied 
Mathematics  (P.  Hilton  and  G.  Young,  eds.),  76-79  (Springer- Verlag,  New  York,  1981). 

95.  K.  Kobzar,  B.  Luy,  N.  Khaneja,  S.  J.  Glaser,  “Pattern  Pulses:  Design  of  arbitrary  excitation  profiles  as  a 
function  of  pulse  amplitude  and  offset,”  J.  Magn.  Reson.  in  Press. 

96.  C.  K.  Law  and  J.  H.  Eberly,”  Arbitrary  control  of  a  quantum  electromagnetic  field,”  Phys.  Rev.  Lett.  ,  76, 
1055  (1996). 

97.  B.  Kneer  and  C.  K.  Law,  “Preparation  of  arbitrary  entangled  quantum  states  of  a  trapped  ion  "Phys. 
Rev.  A,  57,  2096  (1998). 

98.  D.  D’Alessandro,  “Constructive  controllability  of  one  and  two  spin  1/2  particles,”  Proceedings  2001 
American  Control  Conference,  Arlington,  Virginia,  June  2001. 

99.  D.  D’Alessandro,  “Small  time  controllability  of  systems  on  compact  Lie  groups  and  spin  angular 
momentum,”  J.  Math.  Phys.  42,  4488-4496  (2001). 

100.  M.  Dahleh,  A.  Pierce,  H.  Rabitz  and  V.  Ramakrishna,  “Control  of  Molecular  Motion,”  Proc.  IEEE,  84, 
(1996). 

101.  V.  Ramakrishna,  H.  Rabitz,  M.  V.  Salapaka,  M.  Dahleh  and  A.  Peirce,  “Controllability  of  the  Molecular 
Systems,”  Phys.  Rev.  A  51:960-66  (1995). 

102.  S.  G.  Schirmer,  H.  Fu  and  A.  I.  Solomon,  “Complete  Controllability  of  Quantum  Systems,”  Phys.  Rev. 
A  63  063410  (2001). 

103.  G.  Turnici  and  H.  Rabitz,  “Quantum  Wave  Function  Controllability,”  Chem.  Phys.  267:1-9  (2001). 

104.  C.  Altafini,  “Controllability  of  quantum  mechanical  systems  by  root  space  decomposition  of  su(N),”  J. 
Math.  Phys.,  43(5)  2051-2062  (2002). 

105.  C.  Altafini,  “Controllability  properties  of  finite  dimensional  quantum  Markovian  master  equation,”  J. 
Math.  Phys.,  44(6)  2357-2372  (2003). 

106.  D.  J.  Tannor  and  A.  Bartana,  “On  the  Interplay  of  Control  Fields  and  Spontaneous  Emission  in  Laser 
Cooling,”  J.  Phys.  Chem.  A,  103,  10359  (1999). 

107.  S.  E.  Sklarz,  D.  J.  Tannor  and  N.  Khaneja,  “Optimal  Control  of  Quantum  Dissipative  Dynamics:  Analytic 
solution  for  cooling  the  three  level  Lambda  system,”  Phys.  Rev.  A  69,  053408  (2004). 

108.  B.  Kraus  and  J.  I.  Cirac,  “Optimal  creation  of  entanglement  using  a  two  qubits  gate,”  Phys.  Rev.  A  63, 
062309  (2001). 

109.  G.  Vidal,  K.  Hammerer  and  J.  I.  Cirac,  “Interaction  cost  of  nonlocal  gates,”  Phys.  Rev.  Lett.  88,  237902 

(2002). 

110.  J.  Zhang,  J.  Vala,  S.  Sastry,  and  K.  B.  Whaley,  “Minimum  construction  of  two-qubit  quantum  operations,” 


Copyright  ©  2004  John  Wiley  &  Sons,  Ltd. 
Prepared  using  rncauth.cls 


Int.  J.  Robust  Nonlinear  Control  2004;  0:0-0 


24 


H.  MABUCHI  AND  N.  KHANEJA 


Phys.  Rev.  Lett.  93,  020502  (2004). 

111.  J.  Zhang,  J.  Vala,  S.  Sastry,  and  K.  B.  Whaley,  “Exact  two-qubit  universal  quantum  circuit,”  Phys.  Rev. 
Lett.  91,  027903  (2003). 

112.  J.  Zhang,  J.  Vala,  S.  Sastry,  and  K.  B.  Whaley,  “Geometric  theory  of  nonlocal  two-qubit  operations," 
Phys.  Rev.  A  67,  042313  (2003). 

113.  S.  Lloyd,  “Coherent  quantum  feedback,”  Phys.  Rev.  A  62,  022108  (2000). 

114.  A.  Silberfarb,  P.  S.  Jessen  and  I.  H.  Deutsch,  “Quantum  state  reconstruction  via  continuous 
measurement,”  quant-ph/0412032  (2004). 

115.  L.  Bouten,  M.  Guta  and  H.  Maassen,  “Stochastic  Schrodinger  equations,”  J.  Phys.  A  37,  3189-3209 
(2004). 

116.  H.  M.  Wiseman  and  G.  J.  Milburn,  “Quantum-theory  of  field-quadrature  measurements,”  Phys.  Rev.  A 
47,  642-662  (1993). 

117.  C.  W.  Gardiner  and  P.  Zoller,  Quantum  Noise  (Springer,  Berlin,  2004). 

118.  M.  R.  James,  “Risk-sensitive  optimal  control  of  quantum  systems,”  Phys.  Rev.  A  69,  032108  (2004). 

119.  H.  M.  Wiseman,  “In-loop  squeezing  is  like  real  squeezing  to  an  in-loop  atom,”  Phys.  Rev.  Lett.  81, 
3840-3843  (1998). 

120.  L.  Bouten,  “Filtering  and  control  in  quantum  optics,”  quant-ph/0410080  (2004). 

121.  H.  J.  Carmichael,  An  Open  Systems  Approach  to  Quantum  Optics  (Springer,  Berlin,  1993). 

122.  L.  K.  Thomsen,  S.  Mancini  and  H.  M.  Wiseman,  “Continuous  quantum  nondemolition  feedback  and 
unconditional  atomic  spin  squeezing,”  J.  Phys.  B  35,  4937-4952  (2002). 

123.  J.  K.  Stockton,  R.  van  Handel  and  H.  Mabuchi,  “Deterministic  Dicke-state  preparation  with  continuous 
measurement  and  control,”  Phys.  Rev.  A  70,  022106  (2004). 

124.  V.  P.  Belavkin,  “Optimal  measurement  and  control  in  quantum  dynamical  systems,”  Preprint  Instytut 
Fizyki  411,  3-38  (1979);  also  available  at  http://urww.maths.nott.ac.uk/personal/vpb. 

125.  H.  M.  Wiseman  and  A.  C.  Doherty,  “Optima!  unravellings  for  feedback  control  in  linear  quantum  systems,” 
quant-ph/0408099  (2004). 

126.  JM  Geremia,  J.  K.  Stockton,  A.  C.  Doherty  and  H.  Mabuchi,  “Quantum  Kalman  filtering  and  the 
Heisenberg  Limit  in  atomic  magnetometry,”  Phys.  Rev.  Lett.  91,  250801  (2003). 

127.  R.  van  Handel,  “Almost  global  stochastic  stability,”  math. PR/0411311  (2004). 

128.  H.  Mabuchi,  “Dynamical  identification  of  open  quantum  systems,”  Quantum  Semiclass.  Opt.  8,  1103 
(1996). 

129.  F.  Verstraete,  A.  C.  Doherty  and  H.  Mabuchi,  “Sensitivity  optimization  in  quantum  parameter 
estimation,”  Phys.  Rev.  A  64,  032111  (2001). 

130.  P.  Warszawski,  J.  Gambetta  and  H.  M.  Wiseman,  “Dynamical  parameter  estimation  using  realistic 
photodetection,”  Phys.  Rev.  A  69,  042104  (2004). 

131.  R.  W.  Brockett,  N.  Khaneja,  S.  J.  Glaser,  “Optimal  input  design  for  NMR  identification  problem,” 
Proceedings  of  IEEE  Conference  on  Decision  and  Control  (2001). 

132.  R.  S.  Judson  and  H.  Rabitz,  "Teaching  Lasers  to  Control  Molecules,”  Phys.  Rev.  Lett.  68,  1500-1503 
(1992). 

133.  Assion,  T.  Baumert,  M.  Bergt,  T.  Brixner,  B.  Kiefer,  V.  Seyfried,  M.  Strehle,  and  G.  Gerber,  "Control  of 
chemical  reactions  by  feedback-optimized  phase-shaped  femtosecond  laser  pulses,”  Science  282,  919-922 
(1998). 

134.  R.  J.  Levis,  G.  M.  Menkir,  and  H.  Rabitz,  "Selective  bond  dissociation  and  rearrangement  with  optimally 
tailored,  strong-field  laser  pulses,”  Science  292,  709-713  (2001). 

135.  R.  L.  Kosut,  I.  Walmsley,  Y.  Eldar  and  H.  Rabitz,  “Quantum  state  detector  design:  Optimal  worst-case 
a  posteriori  performance,”  quant-ph/0403150  (2004). 

136.  J.-I.  Cirac,  A.  K.  Ekert,  S.  F.  Huelga  and  C.  Macchiavello,  “Distributed  quantum  computation  over  noisy 
channels,”  Phys.  Rev.  A  59,  4249-4254  (1999). 


Copyright  ©  2004  John  Wiley  &  Sons,  Ltd. 
Prepared  using  rncauth.cls 


Int.  J.  Robust  Nonlinear  Control  2004;  0:0-0 


AFRL-SR-AR-TR-05- 


REPORT  DOCUMENTATION  PAGE 


Ol^j 


The  public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  tim - - - . - m - . - 

gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of 
information,  including  suggestions  for  reducing  the  burden,  to  Department  of  Defense,  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports  (0704-0188), 
1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington,  VA  22202*4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  any 
penalty  for  fating  to  comply  with  a  collection  of  information  if  it  does  not  display  a  currently  valid  OMB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 


1.  REPORT  DATE  (DD-MM-YYYY)  2.  REPORT  TYPE 

1 


4.  TITLE  AND  SUBTITLE 

Workshop  on  Quantum  control  Theory  and  Its  Application 


6.  AUTHOR(S) 

■Richard  Murray 


3.  DATES  COVERED  (From  -  To) 

1  March  2004  -  30  November  2004 


5a.  CONTRACT  NUMBER 


5b.  GRANT  NUMBER 

FA95 50-04- 1-0170 


5c.  PROGRAM  ELEMENT  NUMBER 


5d.  PROJECT  NUMBER 


5e.  TASK  NUMBER 


5f.  WORK  UNIT  NUMBER 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

California  Institute  of  Technology 
Pasadena,  CA  91125 


8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

Air  Force  Office  of  Scientific  Research 
4015  Wilson  Blvd 
Mail  Room  713 
Arlington,  VA  22203 


10.  SPONSOR/MONITOR'S  ACRONYM(S) 

AFOSR 


11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 


12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Distribution  Statement  A.  Approved  for  public  release;  distribution  is  unlimited. 


14.  ABSTRACT 

The  grant  supported  a  workshop,  held  at  Caltech  in  August  2004,  that  brought  together  experts  in  quantum  mechanics,  control 
theory,  and  dynamical  systems  for  awn  exchange  of  ideas  on  the  analysis,  control,  and  design  of  quantum  systems.  One  of  the  major 
goals  of  the  workshop  was  to  establish  substantive  technical  interactions  between  physicists  working  on  quantum  'applications'  and 
control  and  dynamical  systems  researchers  who  have  insights  and  tools  but  lack  a  concrete  sense  of  what  problems  are  of  primary 
interest.  The  workshop  highlighted  anticipated  applications  of  quantum  control  in  quantum  information  science,  control  of 
molecular  reactions,  and  design  of  electronic  and  photonic  nanostructures.  The  workshop  results  are  available  on  the  web  and 
documented  in  a  paper  that  has  been  submitted  to  the  International  Journal  of  Robust  and  Nonlinear  Control. 


16.  SECURITY  CLASSIFICATION  OF:  ( 

a.  REPORT 

b.  ABSTRACT 

c.  THIS  PAGE 

U 

U 

u 

17.  LIMITATION  OF 
ABSTRACT 


18.  NUMBER  19a.  NAME  OF  RESPONSIBLE  PERSON 

Richard  Murray 

PAGES  - - - 

19b.  TELEPHONE  NUMBER  (Include  area  code) 

626-395-4140 


Standard  Form  298  (Rev.  8/98) 

Prescribed  by  ANSI  Std.  Z39.18 


